-- Logs begin at Fri 2022-06-24 16:26:27 UTC, end at Fri 2022-06-24 17:41:37 UTC. -- Jun 24 17:12:49.284504 dv-osbrick-847593-1-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jun 24 17:12:49.292887 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 24 17:12:49.295445 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 17:12:49 2022] *** Jun 24 17:12:49.295590 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 17:12:49.295694 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 17:12:49.295795 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: nodename: dv-osbrick-847593-1-ceph Jun 24 17:12:49.295887 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: machine: x86_64 Jun 24 17:12:49.295985 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: clock source: unix Jun 24 17:12:49.296088 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: pcre jit disabled Jun 24 17:12:49.296184 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: detected number of CPU cores: 4 Jun 24 17:12:49.296279 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: current working directory: / Jun 24 17:12:49.296375 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: detected binary path: /usr/bin/uwsgi-core Jun 24 17:12:49.296476 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: your processes number limit is 47680 Jun 24 17:12:49.296574 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: your memory page size is 4096 bytes Jun 24 17:12:49.296726 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: detected max file descriptor number: 2048 Jun 24 17:12:49.296841 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: lock engine: pthread robust mutexes Jun 24 17:12:49.297094 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: thunder lock: enabled Jun 24 17:12:49.297472 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 24 17:12:49.297651 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 17:12:49.345229 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: Python main interpreter initialized at 0x55b2990bc9c0 Jun 24 17:12:49.345229 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: python threads support enabled Jun 24 17:12:49.345229 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: your server socket listen backlog is limited to 100 connections Jun 24 17:12:49.345229 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: your mercy for graceful operations on workers is 90 seconds Jun 24 17:12:49.345582 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 17:12:49.345651 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: *** Operational MODE: preforking *** Jun 24 17:12:49.345888 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: *** uWSGI is running in multiple interpreter mode *** Jun 24 17:12:49.345888 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: spawned uWSGI master process (pid: 87082) Jun 24 17:12:49.346104 dv-osbrick-847593-1-ceph systemd[1]: Started Devstack devstack@keystone.service. Jun 24 17:12:49.347288 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: spawned uWSGI worker 1 (pid: 87095, cores: 1) Jun 24 17:12:49.347288 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: spawned uWSGI worker 2 (pid: 87096, cores: 1) Jun 24 17:12:49.347288 dv-osbrick-847593-1-ceph devstack@keystone.service[87082]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 17:12:55.032449 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 17:12:55.032449 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: from cryptography.utils import int_from_bytes Jun 24 17:12:55.033133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 17:12:55.033133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: from cryptography.utils import int_from_bytes Jun 24 17:12:55.033241 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 17:12:55.033241 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: from cryptography.utils import int_from_bytes Jun 24 17:12:55.033645 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 17:12:55.033645 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: from cryptography.utils import int_from_bytes Jun 24 17:12:55.083671 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 17:12:55.083856 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 17:12:55.083933 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 17:12:55.084024 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 17:12:55.084088 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] command line args: [] {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 17:12:55.084152 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] command line args: [] {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 17:12:55.084285 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 17:12:55.084412 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 17:12:55.084488 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ================================================================================ {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 17:12:55.084563 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ================================================================================ {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 17:12:55.084707 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] admin_token = **** {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.084792 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] admin_token = **** {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.084904 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] config_dir = [] {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.085098 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] config_dir = [] {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.085231 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.085324 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.085389 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] config_source = [] {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.085454 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] config_source = [] {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.085516 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] debug = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.085580 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] debug = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.085646 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.085925 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.086015 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.086075 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.086150 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.086218 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.086358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.086434 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.086601 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.086694 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.086833 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] list_limit = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.086945 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] list_limit = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.087043 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] log_config_append = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.087140 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] log_config_append = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.087241 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.087341 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.087341 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] log_dir = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.087524 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] log_dir = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.087617 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] log_file = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.087721 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] log_file = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.087821 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.087921 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.088047 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.088133 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.088264 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.088339 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.088451 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.088527 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.088653 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.088741 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.088815 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.088936 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.089018 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.089108 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.089189 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.089306 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.089426 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.089501 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.089561 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.089676 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.089760 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.089874 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.089983 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.090098 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.090202 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.090279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.090449 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.090644 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.090782 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.090861 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.091221 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.091417 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.091564 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] publish_errors = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.091658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] publish_errors = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.091823 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.091906 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.092031 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.092201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.092284 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.092409 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.092491 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.092617 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.092697 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.092810 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.093202 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] standard_threads = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.093337 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] standard_threads = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.093542 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.093622 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.093701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.093774 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.093859 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.093940 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.094018 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] use_journal = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.094101 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] use_journal = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.094173 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] use_json = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.094243 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] use_json = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.094323 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] use_stderr = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.094396 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] use_stderr = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.094473 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] use_syslog = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.094546 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] use_syslog = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.094690 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.094766 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 17:12:55.094854 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.094934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.095007 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.095078 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.095149 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.095231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.095310 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.095411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.095514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.095609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.095704 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.095810 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.095906 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.096000 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.096094 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.096188 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.096282 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.096385 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.096482 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.096565 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.096642 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.096794 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.096919 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.097012 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.097089 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.097252 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.097377 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.097467 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.097543 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.097701 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.097783 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.097920 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.098034 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.098158 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.098256 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.098419 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.098543 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.098652 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.098743 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.098920 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.099044 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.099141 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.099212 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.099389 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.099514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.099604 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.099684 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.099861 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.099985 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.100064 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.100138 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.100294 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.100417 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.100511 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.100588 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.100736 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.100870 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.100952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.101025 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.101200 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.101325 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.101417 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.101495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.101611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.101713 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.101864 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.101996 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.102080 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.102151 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.102317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.102454 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.102537 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.102669 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.102770 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.102852 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.103029 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.103247 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.103338 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.103412 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.103573 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.103657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.103800 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.103893 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.104030 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.104112 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.104252 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.104335 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.104479 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.104571 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.104715 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.104797 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.104936 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.105016 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.105171 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.105264 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.105398 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.105481 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.105624 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.105712 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.105849 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.105938 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.106082 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.106163 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.106302 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.106382 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.106536 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.106709 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.106789 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.106860 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.107012 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.107092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.107240 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.107330 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.107452 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.107537 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.107676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.107760 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.107901 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.107987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.108520 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.108627 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.108712 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.108887 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.109002 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.109087 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.109195 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.109291 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.109416 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.109494 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.109604 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.109683 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.109833 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.109921 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.110066 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.110152 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.110296 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.110380 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.110546 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.110693 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.110809 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.110894 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.111046 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.111124 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.111277 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.111364 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.111507 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.111585 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.111738 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.111830 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.111979 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.112121 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.112198 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.112259 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.112431 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.112516 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.112667 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.112749 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.112898 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.112978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.113128 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.113209 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.113357 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.113437 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.113586 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.113667 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.113815 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.113901 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.114052 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.114146 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.114287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.114365 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.114521 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.114631 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.114783 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.114859 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.115003 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.115081 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.115232 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.115309 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.115462 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.115551 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.115691 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.115769 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.115913 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.115990 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.116135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.116223 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.116359 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.116440 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.116582 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.116659 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.116804 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.116881 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.117028 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.117107 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.117255 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.117332 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.117486 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.117563 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.117714 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.117793 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.117948 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.118025 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.118216 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.118297 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.118427 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.118506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.118677 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] auth.external = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.118759 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.118903 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.118982 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] auth.external = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.119129 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.119209 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.119407 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.119495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.119629 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] auth.password = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.119708 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.119854 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] auth.password = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.119940 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] auth.token = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.120082 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] auth.token = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.120161 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.120307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.120384 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.120539 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.120625 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.120760 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.120838 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.120996 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.121073 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.121231 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.121318 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.121455 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.121541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.121684 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] credential.caching = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.121763 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.121918 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] credential.caching = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.122003 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.122154 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.122232 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.122392 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.122477 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.122643 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.122741 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.122877 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.122956 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.123105 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.123183 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.123338 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.123428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.123584 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.123663 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.123813 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.123892 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.124056 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.124290 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.124406 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.124518 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.124629 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.124707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.124850 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.124939 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.125091 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.125171 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.125333 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.125412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.125560 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] federation.caching = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.125650 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.125791 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.125870 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] federation.caching = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.126026 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.126103 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.126262 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.126351 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.126486 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.126580 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.126741 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.126822 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.126971 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.127063 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.127210 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.127287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.127437 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.127519 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.127679 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.127765 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.127906 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.127985 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.128147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.128225 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.128377 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] identity.caching = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.128537 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.128613 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] identity.caching = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.128684 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.128838 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.128918 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.129066 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.129152 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.129295 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.129374 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.129525 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.129603 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.129747 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.129826 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.129978 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.130056 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.130209 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.130286 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.130447 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.130529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.130685 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.130767 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.130912 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.130991 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.131137 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.131218 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.131366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.131443 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.131604 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.131681 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.131842 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.131922 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.132084 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.132162 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.132321 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.132398 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.132565 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.132644 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.132804 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.132881 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.133035 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.133113 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.133259 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.133339 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.133489 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.133567 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.133713 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.133792 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.133935 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.134016 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.134164 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.134244 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.134394 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.134478 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.134648 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.134730 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.134879 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.134957 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.135108 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.135185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.135350 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.135430 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.135579 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.135658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.135810 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.135888 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.136048 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.136127 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.136273 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.136353 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.136504 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.136581 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.136726 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.136805 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.136952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.137029 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.137181 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.137258 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.137413 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.137492 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.137641 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.137718 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.137871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.137950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.138103 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.138181 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.138341 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.138419 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.138624 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.138708 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.138816 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.138897 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.139040 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.139118 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.139284 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.139362 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.139512 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.139593 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.139767 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.139859 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.140001 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.140078 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.140224 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.user = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.140310 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.140448 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.user = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.140526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.140686 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.140802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.140900 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.140976 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.141137 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.141216 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.141374 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.141461 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.141612 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.141691 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.141841 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.141921 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.142065 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.142152 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.142287 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.142365 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.142511 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.142610 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.142765 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.142856 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.142986 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.143064 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.143218 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.143320 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.143452 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.143555 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.143690 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.143771 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.143923 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.144001 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.144158 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.144248 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.144399 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.144559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.144639 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.144712 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.144837 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.144926 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.145063 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.145141 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.145292 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.145369 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.145516 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.145603 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.145747 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.145825 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.145983 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.146061 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.146212 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.146299 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.146442 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.146520 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.146692 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.146774 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.146932 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.147020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.147165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.147244 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.147395 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.147474 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.147624 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.147711 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.147857 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.147936 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.148093 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.148170 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.148319 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.148407 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.148547 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.148625 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.148779 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] resource.caching = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.148857 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.149015 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] resource.caching = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.149102 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.149252 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.149330 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.149482 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.149561 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.149716 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.149802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.149957 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.150035 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.150190 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.150272 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.150422 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.150594 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.150673 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.150745 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.150895 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.150974 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.151123 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] role.caching = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.151212 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.151353 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] role.caching = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.151431 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] role.driver = sql {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.151578 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.151655 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] role.driver = sql {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.151809 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.151894 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.152052 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.152130 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.152292 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.152369 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.152529 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.152615 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.152768 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.152846 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.153006 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.153083 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.153245 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.153324 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.153485 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.153561 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.153709 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.153787 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.153944 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.154023 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.154181 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.154258 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.154418 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.154495 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.154682 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.154765 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.154926 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.155066 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.155296 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.155483 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.155610 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.155691 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.155872 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.155951 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.156119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.156198 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.156364 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.156444 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.156608 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.156688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.156838 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.156917 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.157085 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.157172 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.157322 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.157400 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.157549 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.157629 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.157773 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.157852 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.157995 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.158072 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.158218 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.158296 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.158465 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.158546 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.158737 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.158818 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.158968 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.159060 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.159197 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.159276 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.159422 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.159502 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.159647 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.159732 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] token.caching = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.159875 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.159953 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] token.caching = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.160105 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.160182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.160332 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.160461 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.160570 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.160668 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.160805 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.160905 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.161032 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.161122 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.161264 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.161341 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.161497 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.161575 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.161733 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.161819 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.161961 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.162038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.162190 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.162268 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.162418 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.162505 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.162672 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.162753 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.162912 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.162990 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.163136 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.163227 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.163366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.163444 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.163607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.163687 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.163888 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] database.connection = **** {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.163978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.164126 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.164214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] database.connection = **** {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.164366 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.164456 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.164599 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.164678 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.164830 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.164907 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.165057 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.165136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.165285 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.165364 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.165514 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.165591 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.165740 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.165819 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.165972 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.166049 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.166199 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.166277 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.166435 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.166514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.166695 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.166777 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.166926 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.167004 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.167153 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.167232 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.167387 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.167464 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.167611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.167690 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.167839 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.167918 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.168067 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.168144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.168218 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 17:12:55.168291 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 17:12:55.168446 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 17:12:55.196849 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.197090 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.197323 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.197448 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.197648 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.197776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.205777 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.206298 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.233559 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.233889 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.234037 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.234213 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.287281 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.287549 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.334889 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.335070 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.335338 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.335582 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.402470 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.402696 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.402797 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.402879 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.402943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.403008 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.403071 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.403199 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.403289 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.403474 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.403598 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.403668 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.426448 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.426668 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.426766 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.426917 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.427042 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.427111 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.427207 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.427286 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.427349 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.427533 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.427659 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.427743 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.427824 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.427899 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.438488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.438702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.451160 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.451308 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.451377 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.451553 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.451678 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.451747 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.451832 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.451950 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.452029 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.452185 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.452338 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.452425 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.452498 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87096) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.452648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 17:12:55.469635 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.469850 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 17:12:55.470165 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.470289 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.470358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 17:12:55.470421 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 17:12:55.470608 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.470813 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.470970 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.471059 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 17:12:55.471135 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.471233 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.471320 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.471517 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.471750 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.472019 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.482202 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.482468 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.482753 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.482898 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.483338 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.483571 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.483986 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.484123 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.491439 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.492141 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.494674 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.494952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.495205 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.495391 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.495485 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.495633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.495718 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.495905 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.495989 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.496179 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.496264 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.496450 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.496533 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.496702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.496793 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.496962 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.497048 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.497229 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.497313 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.497582 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.497851 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.498118 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.523405 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.524092 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.524991 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.525262 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.525674 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.525945 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.530553 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.530905 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.531234 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.531357 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.531704 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.531987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.538433 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.538677 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.539154 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.539426 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.543087 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.543362 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.543634 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.543861 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.543984 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.544107 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.544219 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.544386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.544533 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.544646 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.544733 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.545019 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.545144 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.545306 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.545574 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.545840 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.563890 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.564153 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.565620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.565899 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.568791 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.570523 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.572424 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.572710 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.574158 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.574445 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.577720 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.579552 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.581299 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.583123 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.584905 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.585198 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.585466 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.586715 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.587002 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.587283 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.587409 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.587563 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.587847 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.589131 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.589367 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.589651 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.606613 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.606893 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.607151 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.607421 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.608809 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.609062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.609349 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.609619 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.615788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.617483 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.617591 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.617753 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.619239 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.619505 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.620793 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.621072 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.621343 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.621628 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.621896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.622494 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.622771 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.623044 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.623334 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.623609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.635160 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.635404 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.635699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.635971 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.636241 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.636508 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.636777 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.636902 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.637117 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.637407 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.637684 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.637937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.638204 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.638463 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.654410 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.656220 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.657918 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.659577 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.661269 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.662866 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.663011 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.664471 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.664599 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.664754 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.665029 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.666110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.666382 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.666691 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.672478 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.674050 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.674194 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.675714 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.677242 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.677521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.677799 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.678077 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.678883 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.679166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.679441 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.679718 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.687095 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.687370 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.687647 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.688648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.688923 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.689157 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.695586 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87096) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.695853 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.696121 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.696390 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.696657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.696930 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.697075 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 17:12:55.697149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.697301 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.697432 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.697574 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.697713 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.697812 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.697901 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.698108 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.698293 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.698380 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.698445 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.698658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.698784 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.698890 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.699002 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87096) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.699167 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.699420 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.699679 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.699950 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.700209 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.700459 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 17:12:55.737107 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b2990bc9c0 pid: 87096 (default app) Jun 24 17:12:55.738972 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b2990bc9c0 pid: 87095 (default app) Jun 24 17:12:55.740451 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e94e60-23b4-45b6-81a8-4471e5e8efe3 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:12:55.740734 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e94e60-23b4-45b6-81a8-4471e5e8efe3 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:12:55.741000 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e94e60-23b4-45b6-81a8-4471e5e8efe3 None None] PATH_INFO: `/v3` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:12:55.745396 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Fri Jun 24 17:12:55 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:03.908526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aade006-4496-4539-8c9b-15e0070c154f None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:03.909493 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aade006-4496-4539-8c9b-15e0070c154f None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:03.909493 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aade006-4496-4539-8c9b-15e0070c154f None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:03.916782 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:03 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:03.923797 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aee231-46ad-47e1-acc0-af1d2d8b9c21 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:03.924235 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aee231-46ad-47e1-acc0-af1d2d8b9c21 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:03.924362 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aee231-46ad-47e1-acc0-af1d2d8b9c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:04.004050 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: INFO dbcounter [None req-07aee231-46ad-47e1-acc0-af1d2d8b9c21 None None] Registered counter for database keystone Jun 24 17:13:04.028072 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG oslo_db.sqlalchemy.engines [None req-07aee231-46ad-47e1-acc0-af1d2d8b9c21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 17:13:04.036589 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writer thread running {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 17:13:04.332706 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG passlib.handlers.bcrypt [None req-07aee231-46ad-47e1-acc0-af1d2d8b9c21 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87096) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 17:13:04.333109 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG passlib.handlers.bcrypt [None req-07aee231-46ad-47e1-acc0-af1d2d8b9c21 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87096) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 17:13:04.389892 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-07aee231-46ad-47e1-acc0-af1d2d8b9c21 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:04.391540 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-07aee231-46ad-47e1-acc0-af1d2d8b9c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:04.529394 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 608 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 24 17:13:04.723069 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aade006-4496-4539-8c9b-15e0070c154f None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:04.810190 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: INFO dbcounter [None req-9aade006-4496-4539-8c9b-15e0070c154f None None] Registered counter for database keystone Jun 24 17:13:04.832372 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG oslo_db.sqlalchemy.engines [None req-9aade006-4496-4539-8c9b-15e0070c154f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87095) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 17:13:04.844080 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writer thread running {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 17:13:04.968242 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aade006-4496-4539-8c9b-15e0070c154f None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:04.975448 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe5a03-8fab-4e7c-8f5d-e74d50ba83ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:04.976057 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe5a03-8fab-4e7c-8f5d-e74d50ba83ff admin admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:04.976336 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe5a03-8fab-4e7c-8f5d-e74d50ba83ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:04.976607 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe5a03-8fab-4e7c-8f5d-e74d50ba83ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:04.990780 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe5a03-8fab-4e7c-8f5d-e74d50ba83ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:05.152010 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: WARNING keystone.common.rbac_enforcer.enforcer [None req-19fe5a03-8fab-4e7c-8f5d-e74d50ba83ff admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 17:13:05.152345 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe5a03-8fab-4e7c-8f5d-e74d50ba83ff admin admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:05.163767 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Fri Jun 24 17:13:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 17:13:05.171856 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aee231-46ad-47e1-acc0-af1d2d8b9c21 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:05.189876 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aee231-46ad-47e1-acc0-af1d2d8b9c21 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:05.196147 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32c337-e342-4d7f-a592-c85c6f514f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:05.197279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32c337-e342-4d7f-a592-c85c6f514f44 admin admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:05.197559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32c337-e342-4d7f-a592-c85c6f514f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:05.197831 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32c337-e342-4d7f-a592-c85c6f514f44 admin admin] PATH_INFO: `/v3/projects/df2ee206730346a086b9b4fdd7759036` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:05.199385 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32c337-e342-4d7f-a592-c85c6f514f44 admin admin] RBAC: Authorizing `identity:get_project(project_id=df2ee206730346a086b9b4fdd7759036)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:05.252046 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bf32c337-e342-4d7f-a592-c85c6f514f44 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 17:13:05.252315 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32c337-e342-4d7f-a592-c85c6f514f44 admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:05.256997 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Fri Jun 24 17:13:05 2022] GET /identity/v3/projects/df2ee206730346a086b9b4fdd7759036 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:07.511512 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddabda-4c00-47b5-b0b0-d1da2bf8d30e None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:07.512381 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddabda-4c00-47b5-b0b0-d1da2bf8d30e None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:07.512723 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddabda-4c00-47b5-b0b0-d1da2bf8d30e None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:07.518228 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:07.524364 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1897a2-7faa-43e6-afa2-0f844146da34 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:07.524789 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1897a2-7faa-43e6-afa2-0f844146da34 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:07.524916 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1897a2-7faa-43e6-afa2-0f844146da34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:07.545405 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-0b1897a2-7faa-43e6-afa2-0f844146da34 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:07.547540 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-0b1897a2-7faa-43e6-afa2-0f844146da34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:07.558013 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 24 17:13:07.583512 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddabda-4c00-47b5-b0b0-d1da2bf8d30e None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:07.606518 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddabda-4c00-47b5-b0b0-d1da2bf8d30e None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:07.613129 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aba4bf-78d8-4955-9aa5-50eb66ab4bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:07.613755 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aba4bf-78d8-4955-9aa5-50eb66ab4bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:07.614031 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aba4bf-78d8-4955-9aa5-50eb66ab4bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:07.614298 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aba4bf-78d8-4955-9aa5-50eb66ab4bd2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:07.622603 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aba4bf-78d8-4955-9aa5-50eb66ab4bd2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:07.624417 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aba4bf-78d8-4955-9aa5-50eb66ab4bd2 admin admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:07.633495 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Fri Jun 24 17:13:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 17:13:07.639077 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1897a2-7faa-43e6-afa2-0f844146da34 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:07.650448 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1897a2-7faa-43e6-afa2-0f844146da34 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:07.657242 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5857554-865f-419f-90a5-795c842bfd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:07.658137 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5857554-865f-419f-90a5-795c842bfd99 admin admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:07.658416 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5857554-865f-419f-90a5-795c842bfd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:07.658718 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5857554-865f-419f-90a5-795c842bfd99 admin admin] PATH_INFO: `/v3/users/f9689251030946e8ba0417a0a5385957` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:07.660275 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5857554-865f-419f-90a5-795c842bfd99 admin admin] RBAC: Authorizing `identity:get_user(user_id=f9689251030946e8ba0417a0a5385957)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:07.662148 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5857554-865f-419f-90a5-795c842bfd99 admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:07.663782 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Fri Jun 24 17:13:07 2022] GET /identity/v3/users/f9689251030946e8ba0417a0a5385957 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:10.011458 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8821db-c2a9-493a-b1a9-7847eb06b2d4 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:10.012021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8821db-c2a9-493a-b1a9-7847eb06b2d4 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:10.012021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8821db-c2a9-493a-b1a9-7847eb06b2d4 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:10.013445 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:10.018899 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7013d0-d6a6-436a-b6c5-89fc09d64691 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:10.019339 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7013d0-d6a6-436a-b6c5-89fc09d64691 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:10.019418 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7013d0-d6a6-436a-b6c5-89fc09d64691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:10.023771 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe8048-c6c7-4e7e-8aab-157677a3e60d None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:10.024156 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe8048-c6c7-4e7e-8aab-157677a3e60d None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:10.024572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe8048-c6c7-4e7e-8aab-157677a3e60d None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:10.026023 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:10.032206 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9724cb-a929-47fc-a493-fbeaf5001b73 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:10.032489 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9724cb-a929-47fc-a493-fbeaf5001b73 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:10.032767 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9724cb-a929-47fc-a493-fbeaf5001b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:10.041045 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-cc7013d0-d6a6-436a-b6c5-89fc09d64691 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:10.042325 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-cc7013d0-d6a6-436a-b6c5-89fc09d64691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:10.074307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG passlib.handlers.bcrypt [None req-1a9724cb-a929-47fc-a493-fbeaf5001b73 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87095) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 17:13:10.074777 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG passlib.handlers.bcrypt [None req-1a9724cb-a929-47fc-a493-fbeaf5001b73 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87095) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 17:13:10.119980 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-1a9724cb-a929-47fc-a493-fbeaf5001b73 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:10.121553 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-1a9724cb-a929-47fc-a493-fbeaf5001b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:10.125798 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:10.150213 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7013d0-d6a6-436a-b6c5-89fc09d64691 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:10.173750 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:10.225751 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 17:13:10.248842 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9724cb-a929-47fc-a493-fbeaf5001b73 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:10.256333 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7013d0-d6a6-436a-b6c5-89fc09d64691 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:10.292633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d80dc-bcc3-478e-b168-93411e31cc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:10.293373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d80dc-bcc3-478e-b168-93411e31cc83 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:10.293668 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d80dc-bcc3-478e-b168-93411e31cc83 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:10.293937 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d80dc-bcc3-478e-b168-93411e31cc83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:10.304937 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d80dc-bcc3-478e-b168-93411e31cc83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:10.316144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-cd4d80dc-bcc3-478e-b168-93411e31cc83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:13:10.316144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:10.316144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:10.316144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:10.316144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:10.316144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:10.316144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:10.316144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:10.316144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:10.316144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:10.316144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:10.316144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:10.316144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:10.316144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:10.316144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:10.316144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:10.317119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:10.317119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:10.317119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:10.317119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:10.317119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:10.317119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:10.317119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:10.317119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:10.317119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:10.317119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:10.317119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:10.317119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:10.317119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:10.317119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:10.317119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:10.317119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:10.317934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:10.317934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:10.317934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:10.317934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:10.317934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:10.317934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:10.317934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:10.317934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:10.317934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:10.317934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:10.317934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:13:10.317934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:13:10.317934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 24 17:13:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:13:10.324632 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d80dc-bcc3-478e-b168-93411e31cc83 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:10.352429 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9724cb-a929-47fc-a493-fbeaf5001b73 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:10.354751 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:10.392232 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c8600-eb69-4be3-92c8-a8b81cd67571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:10.393195 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c8600-eb69-4be3-92c8-a8b81cd67571 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:10.393487 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c8600-eb69-4be3-92c8-a8b81cd67571 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:10.393765 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c8600-eb69-4be3-92c8-a8b81cd67571 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:10.408465 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:10.427652 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d80dc-bcc3-478e-b168-93411e31cc83 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:10.460585 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09720f8f-8a53-47d7-804f-73d3db29c338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:10.461242 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09720f8f-8a53-47d7-804f-73d3db29c338 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:10.461520 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09720f8f-8a53-47d7-804f-73d3db29c338 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:10.461789 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09720f8f-8a53-47d7-804f-73d3db29c338 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:10.462524 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09720f8f-8a53-47d7-804f-73d3db29c338 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:10.462853 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09720f8f-8a53-47d7-804f-73d3db29c338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:10.464231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09720f8f-8a53-47d7-804f-73d3db29c338 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:10.465131 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c8600-eb69-4be3-92c8-a8b81cd67571 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:10.466699 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c8600-eb69-4be3-92c8-a8b81cd67571 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:10.476520 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 8/15] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:13:10.482878 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09720f8f-8a53-47d7-804f-73d3db29c338 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:10.569431 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 8/16] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:13:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 17:13:10.575046 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c8600-eb69-4be3-92c8-a8b81cd67571 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:10.578325 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:10.581358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09720f8f-8a53-47d7-804f-73d3db29c338 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:10.615818 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fc3a5-48cd-4300-a3e9-4e486f7d8710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:10.616686 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fc3a5-48cd-4300-a3e9-4e486f7d8710 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:10.616999 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fc3a5-48cd-4300-a3e9-4e486f7d8710 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:10.617263 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fc3a5-48cd-4300-a3e9-4e486f7d8710 None admin] PATH_INFO: `/v3/users/f9689251030946e8ba0417a0a5385957` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:10.618448 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fc3a5-48cd-4300-a3e9-4e486f7d8710 None admin] RBAC: Authorizing `identity:get_user(user_id=f9689251030946e8ba0417a0a5385957)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:10.619935 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fc3a5-48cd-4300-a3e9-4e486f7d8710 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:10.621514 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 9/17] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:10 2022] GET /identity/v3/users/f9689251030946e8ba0417a0a5385957 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:10.626965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fc3a5-48cd-4300-a3e9-4e486f7d8710 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:10.641785 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:10.675191 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c8600-eb69-4be3-92c8-a8b81cd67571 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:10.709426 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569210a-f88e-4fc1-a053-bef38df29f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:10.710227 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569210a-f88e-4fc1-a053-bef38df29f90 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:10.710504 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569210a-f88e-4fc1-a053-bef38df29f90 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:10.710808 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569210a-f88e-4fc1-a053-bef38df29f90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:10.728472 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fc3a5-48cd-4300-a3e9-4e486f7d8710 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:10.728969 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569210a-f88e-4fc1-a053-bef38df29f90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:10.730445 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569210a-f88e-4fc1-a053-bef38df29f90 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:10.751620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-a569210a-f88e-4fc1-a053-bef38df29f90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:13:10.751620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:10.751620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:10.751620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:10.751620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:10.751620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:10.751620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:10.751620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:10.751620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:10.751620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:10.751620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:10.751620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:10.751620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:13:10.751620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:13:10.751620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:13:10.752611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:13:10.752611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:10.752611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:10.752611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:10.752611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:10.752611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:10.752611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:10.752611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:10.752611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:10.752611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:10.752611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:10.752611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:10.752611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:10.752611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:10.752611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:10.752611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:10.752611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:10.753573 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:13:10.753573 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:13:10.753573 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:13:10.753573 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:13:10.753573 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 9/18] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:13:10.758615 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569210a-f88e-4fc1-a053-bef38df29f90 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:10.764788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbcf14-a02f-4dbb-bc43-8ec7aa2132d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:10.765622 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbcf14-a02f-4dbb-bc43-8ec7aa2132d6 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:10.765901 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbcf14-a02f-4dbb-bc43-8ec7aa2132d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:10.766178 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbcf14-a02f-4dbb-bc43-8ec7aa2132d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:10.767391 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbcf14-a02f-4dbb-bc43-8ec7aa2132d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:10.768840 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbcf14-a02f-4dbb-bc43-8ec7aa2132d6 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:10.770456 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 10/19] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:13:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:13:10.775997 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbcf14-a02f-4dbb-bc43-8ec7aa2132d6 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:10.814165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:10.859171 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:10.860134 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569210a-f88e-4fc1-a053-bef38df29f90 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:10.879512 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbcf14-a02f-4dbb-bc43-8ec7aa2132d6 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:10.893970 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99a557-8672-4558-bf08-9540a0d3dccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:10.894629 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99a557-8672-4558-bf08-9540a0d3dccf None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:10.894934 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99a557-8672-4558-bf08-9540a0d3dccf None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:10.895216 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99a557-8672-4558-bf08-9540a0d3dccf None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:10.895939 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99a557-8672-4558-bf08-9540a0d3dccf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:10.896217 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99a557-8672-4558-bf08-9540a0d3dccf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:10.897620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99a557-8672-4558-bf08-9540a0d3dccf None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:10.913338 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6d227-d2ad-482e-92b3-065dff5f7f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:10.914025 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6d227-d2ad-482e-92b3-065dff5f7f10 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:10.914296 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6d227-d2ad-482e-92b3-065dff5f7f10 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:10.914588 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6d227-d2ad-482e-92b3-065dff5f7f10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:10.915460 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6d227-d2ad-482e-92b3-065dff5f7f10 None admin] RBAC: Adding query filter params (role.id=ae295b7c396a4e559ecd6d574f097d4a, scope.domain.id=default, user.id=f9689251030946e8ba0417a0a5385957) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:10.915761 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6d227-d2ad-482e-92b3-065dff5f7f10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:10.917248 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6d227-d2ad-482e-92b3-065dff5f7f10 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:10.918247 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 10/20] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:13:10.927194 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 11/21] 10.222.0.15 () {56 vars in 1322 bytes} [Fri Jun 24 17:13:10 2022] GET /identity/v3/role_assignments?user.id=f9689251030946e8ba0417a0a5385957&scope.domain.id=default&role.id=ae295b7c396a4e559ecd6d574f097d4a => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:13:13.630969 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e9678-7c92-44c2-8f15-f8f428c23237 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:13.631988 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e9678-7c92-44c2-8f15-f8f428c23237 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:13.632489 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e9678-7c92-44c2-8f15-f8f428c23237 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:13.634063 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 11/22] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:13.639562 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c86818-3343-4ef2-88b5-3a5c150172e0 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:13.640477 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c86818-3343-4ef2-88b5-3a5c150172e0 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:13.640956 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c86818-3343-4ef2-88b5-3a5c150172e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:13.663637 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-73c86818-3343-4ef2-88b5-3a5c150172e0 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:13.665187 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-73c86818-3343-4ef2-88b5-3a5c150172e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:13.684094 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507eb99-9cdc-4445-8432-3612066fbd9d None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:13.684755 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507eb99-9cdc-4445-8432-3612066fbd9d None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:13.685226 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507eb99-9cdc-4445-8432-3612066fbd9d None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:13.687650 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 12/23] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:13.700564 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8f778-f927-4046-9c67-6155c5e5d63e None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:13.701170 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8f778-f927-4046-9c67-6155c5e5d63e None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:13.701733 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8f778-f927-4046-9c67-6155c5e5d63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:13.741265 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-f9d8f778-f927-4046-9c67-6155c5e5d63e None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:13.742450 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-f9d8f778-f927-4046-9c67-6155c5e5d63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:13.816859 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 12/24] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:13.835612 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 13/25] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:13.841047 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c86818-3343-4ef2-88b5-3a5c150172e0 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:13.884890 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8f778-f927-4046-9c67-6155c5e5d63e None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:13.939237 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:13.986512 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c86818-3343-4ef2-88b5-3a5c150172e0 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:13.989987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:14.051876 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183803b2-ef08-43cb-8afa-1a752a735fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:14.052733 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183803b2-ef08-43cb-8afa-1a752a735fa0 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:14.053015 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183803b2-ef08-43cb-8afa-1a752a735fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:14.053288 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183803b2-ef08-43cb-8afa-1a752a735fa0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:14.075861 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183803b2-ef08-43cb-8afa-1a752a735fa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:14.092149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-183803b2-ef08-43cb-8afa-1a752a735fa0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:13:14.092149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:14.092149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:14.092149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:14.092149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:14.092149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:14.092149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:14.092149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:14.092149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:14.092149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:14.092149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:14.092149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:14.092149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:14.092149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:14.092149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:14.092149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:14.093194 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:14.093194 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:14.093194 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:14.093194 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:14.093194 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:14.093194 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:14.093194 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:14.093194 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:14.093194 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:14.093194 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:14.093194 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:14.093194 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:14.093194 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:14.093194 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:14.093194 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:14.093194 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:14.093952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:14.093952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:14.093952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:14.093952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:14.093952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:14.093952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:14.093952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:14.093952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:14.093952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:14.093952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:14.093952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:13:14.093952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:13:14.093952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 13/26] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 24 17:13:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:13:14.100305 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183803b2-ef08-43cb-8afa-1a752a735fa0 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:14.107136 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8f778-f927-4046-9c67-6155c5e5d63e None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:14.159154 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a68f88-f02b-4d00-89aa-3c7636ee1069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:14.160388 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a68f88-f02b-4d00-89aa-3c7636ee1069 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:14.160855 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a68f88-f02b-4d00-89aa-3c7636ee1069 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:14.161308 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a68f88-f02b-4d00-89aa-3c7636ee1069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:14.191673 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a68f88-f02b-4d00-89aa-3c7636ee1069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:14.193190 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a68f88-f02b-4d00-89aa-3c7636ee1069 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:14.218921 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183803b2-ef08-43cb-8afa-1a752a735fa0 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:14.232483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-38a68f88-f02b-4d00-89aa-3c7636ee1069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:13:14.232483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:14.232483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:14.232483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:14.232483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:14.232483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:14.232483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:14.232483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:14.232483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:14.232483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:14.232483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:14.232483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:14.232483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:13:14.232483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:13:14.232483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:13:14.233402 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:13:14.233402 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:14.233402 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:14.233402 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:14.233402 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:14.233402 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:14.233402 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:14.233402 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:14.233402 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:14.233402 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:14.233402 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:14.233402 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:14.233402 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:14.233402 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:14.233402 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:14.233402 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:14.233402 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:14.234181 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:13:14.234181 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:13:14.234181 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:13:14.234181 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:13:14.234181 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 14/27] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:13:14.248390 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c56cba-e976-453f-a879-9dbca0eb4804 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:14.248701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c56cba-e976-453f-a879-9dbca0eb4804 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:14.248975 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c56cba-e976-453f-a879-9dbca0eb4804 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:14.250623 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 15/28] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:14 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:14.251208 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c56cba-e976-453f-a879-9dbca0eb4804 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:14.259260 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adb392-db41-4866-946e-f5789e455d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:14.259936 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adb392-db41-4866-946e-f5789e455d49 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:14.260220 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adb392-db41-4866-946e-f5789e455d49 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:14.260504 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adb392-db41-4866-946e-f5789e455d49 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:14.261257 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adb392-db41-4866-946e-f5789e455d49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:14.261564 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adb392-db41-4866-946e-f5789e455d49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:14.263018 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adb392-db41-4866-946e-f5789e455d49 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:14.270880 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:14.284992 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 14/29] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:14.286041 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bffa87-7940-4d68-8664-fb76635a5eb4 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:14.286330 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bffa87-7940-4d68-8664-fb76635a5eb4 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:14.286637 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bffa87-7940-4d68-8664-fb76635a5eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:14.319663 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-31bffa87-7940-4d68-8664-fb76635a5eb4 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:14.320893 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-31bffa87-7940-4d68-8664-fb76635a5eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:14.458964 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:14.465545 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c56cba-e976-453f-a879-9dbca0eb4804 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:14.468283 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 15/30] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:14.469160 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bffa87-7940-4d68-8664-fb76635a5eb4 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:14.565487 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10886557-6495-4bc0-9cfd-1044710f3758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:14.566171 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10886557-6495-4bc0-9cfd-1044710f3758 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:14.566455 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10886557-6495-4bc0-9cfd-1044710f3758 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:14.566758 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10886557-6495-4bc0-9cfd-1044710f3758 None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:14.567501 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10886557-6495-4bc0-9cfd-1044710f3758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:14.567807 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10886557-6495-4bc0-9cfd-1044710f3758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:14.569220 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10886557-6495-4bc0-9cfd-1044710f3758 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:14.595524 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 16/31] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:14.596239 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10886557-6495-4bc0-9cfd-1044710f3758 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:14.659522 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bffa87-7940-4d68-8664-fb76635a5eb4 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:14.688173 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:14.698843 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe202e-b2f1-45a6-bc66-181a99f33d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:14.699928 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe202e-b2f1-45a6-bc66-181a99f33d08 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:14.700369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe202e-b2f1-45a6-bc66-181a99f33d08 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:14.700789 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe202e-b2f1-45a6-bc66-181a99f33d08 None admin] PATH_INFO: `/v3/users/f9689251030946e8ba0417a0a5385957` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:14.702337 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe202e-b2f1-45a6-bc66-181a99f33d08 None admin] RBAC: Authorizing `identity:get_user(user_id=f9689251030946e8ba0417a0a5385957)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:14.703915 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe202e-b2f1-45a6-bc66-181a99f33d08 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:14.705989 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 16/32] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:14 2022] GET /identity/v3/users/f9689251030946e8ba0417a0a5385957 => generated 247 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:14.707472 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775a00-020c-4453-b7bd-3c03a43874f5 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:14.707941 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775a00-020c-4453-b7bd-3c03a43874f5 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:14.708409 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775a00-020c-4453-b7bd-3c03a43874f5 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:14.710238 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 17/33] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:14.711101 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1775a00-020c-4453-b7bd-3c03a43874f5 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:14.719920 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10886557-6495-4bc0-9cfd-1044710f3758 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:14.764476 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168626c-a437-4b04-a41f-35237ecaa73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:14.765250 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168626c-a437-4b04-a41f-35237ecaa73b None admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:14.765595 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168626c-a437-4b04-a41f-35237ecaa73b None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:14.765934 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168626c-a437-4b04-a41f-35237ecaa73b None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:14.767181 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168626c-a437-4b04-a41f-35237ecaa73b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:14.768920 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168626c-a437-4b04-a41f-35237ecaa73b None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:14.845461 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1775a00-020c-4453-b7bd-3c03a43874f5 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:14.883150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19a9f3-242b-4f8f-a75b-6cd746e69942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:14.883980 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19a9f3-242b-4f8f-a75b-6cd746e69942 None admin] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:14.884362 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19a9f3-242b-4f8f-a75b-6cd746e69942 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:14.884706 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19a9f3-242b-4f8f-a75b-6cd746e69942 None admin] PATH_INFO: `/v3/projects` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:14.885611 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19a9f3-242b-4f8f-a75b-6cd746e69942 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:14.887146 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19a9f3-242b-4f8f-a75b-6cd746e69942 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:14.919794 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 17/34] 10.222.0.15 () {60 vars in 1131 bytes} [Fri Jun 24 17:13:14 2022] POST /identity/v3/roles => generated 219 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:13:14.921535 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168626c-a437-4b04-a41f-35237ecaa73b None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:14.977832 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:15.070062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168626c-a437-4b04-a41f-35237ecaa73b None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:15.115932 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 18/35] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 24 17:13:14 2022] POST /identity/v3/projects => generated 301 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:13:15.117529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd65b7-9f34-4f6f-a21d-91ee771927d5 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:15.117826 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd65b7-9f34-4f6f-a21d-91ee771927d5 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:15.118101 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd65b7-9f34-4f6f-a21d-91ee771927d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:15.143170 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2687aad-1032-4813-b75b-394681e7448c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:15.144362 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2687aad-1032-4813-b75b-394681e7448c None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:15.144790 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2687aad-1032-4813-b75b-394681e7448c None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:15.145269 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2687aad-1032-4813-b75b-394681e7448c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:15.147725 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2687aad-1032-4813-b75b-394681e7448c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:15.149677 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2687aad-1032-4813-b75b-394681e7448c None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:15.152714 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 18/36] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:13:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:15.157472 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-7abd65b7-9f34-4f6f-a21d-91ee771927d5 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:15.159406 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a1104-ba34-4047-a026-a5ba538ae183 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:15.161766 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a1104-ba34-4047-a026-a5ba538ae183 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:15.161977 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-7abd65b7-9f34-4f6f-a21d-91ee771927d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:15.162182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a1104-ba34-4047-a026-a5ba538ae183 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:15.163637 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 19/37] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:15.164412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a1104-ba34-4047-a026-a5ba538ae183 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:15.222534 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:15.265852 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 19/38] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:15.267221 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80deea-25c8-4317-8ba2-958a13000a95 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:15.267551 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80deea-25c8-4317-8ba2-958a13000a95 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:15.267836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80deea-25c8-4317-8ba2-958a13000a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:15.285877 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-cc80deea-25c8-4317-8ba2-958a13000a95 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:15.287182 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-cc80deea-25c8-4317-8ba2-958a13000a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:15.303456 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:15.331661 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a1104-ba34-4047-a026-a5ba538ae183 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:15.379786 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 20/39] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:15.380578 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91002cc4-e63a-4172-91ff-5ebd50dcf72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:15.381058 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80deea-25c8-4317-8ba2-958a13000a95 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:15.381684 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91002cc4-e63a-4172-91ff-5ebd50dcf72c None admin] REQUEST_METHOD: `PUT` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:15.382045 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91002cc4-e63a-4172-91ff-5ebd50dcf72c None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:15.382524 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91002cc4-e63a-4172-91ff-5ebd50dcf72c None admin] PATH_INFO: `/v3/domains/default/users/f9689251030946e8ba0417a0a5385957/roles/ae295b7c396a4e559ecd6d574f097d4a` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:15.389572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91002cc4-e63a-4172-91ff-5ebd50dcf72c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f9689251030946e8ba0417a0a5385957, role_id=ae295b7c396a4e559ecd6d574f097d4a)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:15.394924 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91002cc4-e63a-4172-91ff-5ebd50dcf72c None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:15.425859 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 20/40] 10.222.0.15 () {58 vars in 1361 bytes} [Fri Jun 24 17:13:15 2022] PUT /identity/v3/domains/default/users/f9689251030946e8ba0417a0a5385957/roles/ae295b7c396a4e559ecd6d574f097d4a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:13:15.426529 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91002cc4-e63a-4172-91ff-5ebd50dcf72c None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:15.530436 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80deea-25c8-4317-8ba2-958a13000a95 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:15.540273 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:15.573279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31966362-42e6-4e51-a690-b23fbd04cfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:15.574952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31966362-42e6-4e51-a690-b23fbd04cfd8 None admin] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:15.575761 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31966362-42e6-4e51-a690-b23fbd04cfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:15.576579 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31966362-42e6-4e51-a690-b23fbd04cfd8 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:15.578332 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31966362-42e6-4e51-a690-b23fbd04cfd8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:15.583602 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31966362-42e6-4e51-a690-b23fbd04cfd8 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:15.591219 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91002cc4-e63a-4172-91ff-5ebd50dcf72c None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:15.610798 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 21/41] 10.222.0.15 () {60 vars in 1131 bytes} [Fri Jun 24 17:13:15 2022] POST /identity/v3/roles => generated 225 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:13:15.635101 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecd2e5-a686-48a1-a140-ef05ae00154f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:15.635817 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecd2e5-a686-48a1-a140-ef05ae00154f None admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:15.636110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecd2e5-a686-48a1-a140-ef05ae00154f None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:15.636389 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecd2e5-a686-48a1-a140-ef05ae00154f None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:15.637204 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ecd2e5-a686-48a1-a140-ef05ae00154f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:15.639096 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ecd2e5-a686-48a1-a140-ef05ae00154f None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:15.659447 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 21/42] 10.222.0.15 () {60 vars in 1131 bytes} [Fri Jun 24 17:13:15 2022] POST /identity/v3/roles => generated 223 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:13:15.716719 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4252b4-40f9-4ef1-8693-06c9e0a83881 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:15.717361 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4252b4-40f9-4ef1-8693-06c9e0a83881 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:15.717361 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4252b4-40f9-4ef1-8693-06c9e0a83881 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:15.718775 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 22/43] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:15.724809 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dda46-bd92-48fd-9c50-87c08ae56227 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:15.725338 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dda46-bd92-48fd-9c50-87c08ae56227 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:15.725421 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dda46-bd92-48fd-9c50-87c08ae56227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:15.740444 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:15.747587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-035dda46-bd92-48fd-9c50-87c08ae56227 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:15.750682 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-035dda46-bd92-48fd-9c50-87c08ae56227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:15.836425 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 22/44] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:15.861724 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4252b4-40f9-4ef1-8693-06c9e0a83881 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:15.975553 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4252b4-40f9-4ef1-8693-06c9e0a83881 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:16.009202 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ab752-b891-4f42-b796-caddf34f4d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:16.009999 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ab752-b891-4f42-b796-caddf34f4d19 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:16.010284 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ab752-b891-4f42-b796-caddf34f4d19 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:16.010558 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ab752-b891-4f42-b796-caddf34f4d19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:16.011755 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ab752-b891-4f42-b796-caddf34f4d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:16.013218 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ab752-b891-4f42-b796-caddf34f4d19 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:16.014906 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 23/45] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:13:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:16.024579 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035dda46-bd92-48fd-9c50-87c08ae56227 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:16.132246 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035dda46-bd92-48fd-9c50-87c08ae56227 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:16.167192 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6833a-04b4-4eb8-abc8-90da20ccdecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:16.167853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6833a-04b4-4eb8-abc8-90da20ccdecc None admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:16.168137 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6833a-04b4-4eb8-abc8-90da20ccdecc None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:16.168412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6833a-04b4-4eb8-abc8-90da20ccdecc None admin] PATH_INFO: `/v3/projects` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:16.169121 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6833a-04b4-4eb8-abc8-90da20ccdecc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:16.170767 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6833a-04b4-4eb8-abc8-90da20ccdecc None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:16.175555 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:16.199333 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 23/46] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 24 17:13:16 2022] POST /identity/v3/projects => generated 312 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:13:17.805879 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adec5d-0451-4718-b03a-9c3fb1e48097 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:17.806458 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adec5d-0451-4718-b03a-9c3fb1e48097 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:17.806458 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adec5d-0451-4718-b03a-9c3fb1e48097 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:17.807839 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 24/47] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:17.813477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5739e9-d7d9-49cc-a59f-098f9579e873 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:17.813873 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5739e9-d7d9-49cc-a59f-098f9579e873 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:17.814128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5739e9-d7d9-49cc-a59f-098f9579e873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:17.832355 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-7f5739e9-d7d9-49cc-a59f-098f9579e873 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:17.833547 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-7f5739e9-d7d9-49cc-a59f-098f9579e873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:17.905756 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 24/48] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:17.929772 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adec5d-0451-4718-b03a-9c3fb1e48097 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:17.966111 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:18.038431 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adec5d-0451-4718-b03a-9c3fb1e48097 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:18.073608 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cc8ae-a593-41b3-ba0f-44770fb00be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:18.074309 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cc8ae-a593-41b3-ba0f-44770fb00be2 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:18.074604 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cc8ae-a593-41b3-ba0f-44770fb00be2 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:18.074894 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cc8ae-a593-41b3-ba0f-44770fb00be2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:18.085002 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cc8ae-a593-41b3-ba0f-44770fb00be2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:18.092757 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-020cc8ae-a593-41b3-ba0f-44770fb00be2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:13:18.092757 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:18.092757 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:18.092757 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:18.092757 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:18.092757 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:18.092757 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:18.092757 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:18.092757 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:18.092757 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:18.092757 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:18.092757 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:18.092757 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:18.092757 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:18.092757 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:18.092757 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:18.093605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:18.093605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:18.093605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:18.093605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:18.093605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:18.093605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:18.093605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:18.093605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:18.093605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:18.093605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:18.093605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:18.093605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:18.093605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:18.093605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:18.093605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:18.093605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:18.094639 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:18.094639 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:18.094639 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:18.094639 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:18.094639 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:18.094639 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:18.094639 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:18.094639 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:18.094639 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:18.094639 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:18.094639 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:13:18.094639 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:13:18.094639 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 25/49] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 24 17:13:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:13:18.099837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5739e9-d7d9-49cc-a59f-098f9579e873 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:18.197913 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5739e9-d7d9-49cc-a59f-098f9579e873 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:18.215567 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:18.235045 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c620c2-7a4c-451b-95a0-1e43c84eadd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:18.235735 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c620c2-7a4c-451b-95a0-1e43c84eadd6 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:18.236012 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c620c2-7a4c-451b-95a0-1e43c84eadd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:18.236283 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c620c2-7a4c-451b-95a0-1e43c84eadd6 None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:18.237060 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c620c2-7a4c-451b-95a0-1e43c84eadd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:18.237360 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c620c2-7a4c-451b-95a0-1e43c84eadd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:18.238860 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c620c2-7a4c-451b-95a0-1e43c84eadd6 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:18.252928 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 25/50] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:18.259555 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cc8ae-a593-41b3-ba0f-44770fb00be2 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:18.357024 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:18.364011 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cc8ae-a593-41b3-ba0f-44770fb00be2 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:18.399066 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617387d-991b-4d4b-ae97-f8aec7d17bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:18.399949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617387d-991b-4d4b-ae97-f8aec7d17bce None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:18.400223 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617387d-991b-4d4b-ae97-f8aec7d17bce None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:18.400493 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617387d-991b-4d4b-ae97-f8aec7d17bce None admin] PATH_INFO: `/v3/users/f9689251030946e8ba0417a0a5385957` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:18.401782 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617387d-991b-4d4b-ae97-f8aec7d17bce None admin] RBAC: Authorizing `identity:get_user(user_id=f9689251030946e8ba0417a0a5385957)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:18.403294 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617387d-991b-4d4b-ae97-f8aec7d17bce None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:18.405292 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 26/51] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:18 2022] GET /identity/v3/users/f9689251030946e8ba0417a0a5385957 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:18.410699 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c620c2-7a4c-451b-95a0-1e43c84eadd6 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:18.471341 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cf0c4-332a-48e9-ab1a-805d2dee6daf None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:18.471726 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cf0c4-332a-48e9-ab1a-805d2dee6daf None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:18.472009 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cf0c4-332a-48e9-ab1a-805d2dee6daf None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:18.473391 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 27/52] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:18.478422 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdad48-88a8-4970-82c6-755a6e0c9f3b None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:18.478747 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdad48-88a8-4970-82c6-755a6e0c9f3b None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:18.479022 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdad48-88a8-4970-82c6-755a6e0c9f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:18.496542 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-98bdad48-88a8-4970-82c6-755a6e0c9f3b None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:18.497780 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-98bdad48-88a8-4970-82c6-755a6e0c9f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:18.513959 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c620c2-7a4c-451b-95a0-1e43c84eadd6 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:18.548739 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32965ca-586d-46bc-9cb0-443fca3f7bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:18.549539 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32965ca-586d-46bc-9cb0-443fca3f7bc5 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:18.549819 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32965ca-586d-46bc-9cb0-443fca3f7bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:18.550088 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32965ca-586d-46bc-9cb0-443fca3f7bc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:18.551290 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32965ca-586d-46bc-9cb0-443fca3f7bc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:18.552769 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32965ca-586d-46bc-9cb0-443fca3f7bc5 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:18.554404 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:13:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:18.560204 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32965ca-586d-46bc-9cb0-443fca3f7bc5 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:18.564584 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 28/54] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:18.588683 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdad48-88a8-4970-82c6-755a6e0c9f3b None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:18.610791 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:18.664090 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32965ca-586d-46bc-9cb0-443fca3f7bc5 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:18.682361 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:18.693318 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdad48-88a8-4970-82c6-755a6e0c9f3b None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:18.700850 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a1e97-7e7c-40bc-86a1-a0acf8353fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:18.701572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a1e97-7e7c-40bc-86a1-a0acf8353fbd None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:18.701942 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a1e97-7e7c-40bc-86a1-a0acf8353fbd None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:18.702222 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a1e97-7e7c-40bc-86a1-a0acf8353fbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:18.703105 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a1e97-7e7c-40bc-86a1-a0acf8353fbd None admin] RBAC: Adding query filter params (role.id=ae295b7c396a4e559ecd6d574f097d4a, scope.domain.id=default, user.id=f9689251030946e8ba0417a0a5385957) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:18.703413 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a1e97-7e7c-40bc-86a1-a0acf8353fbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:18.704895 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a1e97-7e7c-40bc-86a1-a0acf8353fbd None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:18.712990 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1322 bytes} [Fri Jun 24 17:13:18 2022] GET /identity/v3/role_assignments?user.id=f9689251030946e8ba0417a0a5385957&scope.domain.id=default&role.id=ae295b7c396a4e559ecd6d574f097d4a => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:13:18.727063 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa8f29-7bef-4b0d-a069-f79cc2c2d38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:18.727893 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa8f29-7bef-4b0d-a069-f79cc2c2d38e None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:18.728175 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa8f29-7bef-4b0d-a069-f79cc2c2d38e None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:18.728452 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa8f29-7bef-4b0d-a069-f79cc2c2d38e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:18.729696 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa8f29-7bef-4b0d-a069-f79cc2c2d38e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:18.731597 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa8f29-7bef-4b0d-a069-f79cc2c2d38e None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:18.733504 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 29/56] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:13:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:13:18.739656 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a1e97-7e7c-40bc-86a1-a0acf8353fbd None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:18.850690 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a1e97-7e7c-40bc-86a1-a0acf8353fbd None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:18.866003 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:18.892039 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d0796-5ed0-4b4f-b43a-02637dc0a252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:18.892721 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d0796-5ed0-4b4f-b43a-02637dc0a252 None admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:18.893003 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d0796-5ed0-4b4f-b43a-02637dc0a252 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:18.893279 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d0796-5ed0-4b4f-b43a-02637dc0a252 None admin] PATH_INFO: `/v3/projects` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:18.894021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d0796-5ed0-4b4f-b43a-02637dc0a252 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:18.895685 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d0796-5ed0-4b4f-b43a-02637dc0a252 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:18.924367 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 28/57] 10.222.0.15 () {60 vars in 1140 bytes} [Fri Jun 24 17:13:18 2022] POST /identity/v3/projects => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:13:21.180767 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7eba88-1504-4ae5-baee-1094991225f8 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:21.181354 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7eba88-1504-4ae5-baee-1094991225f8 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:21.181354 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7eba88-1504-4ae5-baee-1094991225f8 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:21.182686 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 30/58] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:21.188956 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b06f83-ce2d-4991-994a-aa426ee5c769 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:21.189558 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b06f83-ce2d-4991-994a-aa426ee5c769 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:21.189801 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b06f83-ce2d-4991-994a-aa426ee5c769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:21.217117 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-57b06f83-ce2d-4991-994a-aa426ee5c769 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:21.218340 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-57b06f83-ce2d-4991-994a-aa426ee5c769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:21.295042 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 29/59] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:21.324068 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7eba88-1504-4ae5-baee-1094991225f8 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:21.434823 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7eba88-1504-4ae5-baee-1094991225f8 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:21.471141 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60529e4-5d3b-4c3f-8148-bdb2aa0e55a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:21.471924 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60529e4-5d3b-4c3f-8148-bdb2aa0e55a3 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:21.472201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60529e4-5d3b-4c3f-8148-bdb2aa0e55a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:21.472469 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60529e4-5d3b-4c3f-8148-bdb2aa0e55a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:21.473762 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60529e4-5d3b-4c3f-8148-bdb2aa0e55a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:21.475252 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60529e4-5d3b-4c3f-8148-bdb2aa0e55a3 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:21.476844 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 31/60] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:13:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:21.484268 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b06f83-ce2d-4991-994a-aa426ee5c769 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:21.590540 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:21.600794 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b06f83-ce2d-4991-994a-aa426ee5c769 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:21.650475 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01ce4c-a1fe-48ff-80b5-bb3c3bad69e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:21.651514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01ce4c-a1fe-48ff-80b5-bb3c3bad69e4 None admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:21.651927 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01ce4c-a1fe-48ff-80b5-bb3c3bad69e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:21.652330 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01ce4c-a1fe-48ff-80b5-bb3c3bad69e4 None admin] PATH_INFO: `/v3/users` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:21.653447 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01ce4c-a1fe-48ff-80b5-bb3c3bad69e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:21.655777 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01ce4c-a1fe-48ff-80b5-bb3c3bad69e4 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:21.690186 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 30/61] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 24 17:13:21 2022] POST /identity/v3/users => generated 275 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:13:25.346425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833d727-21b9-4ef1-a281-b5ac0a22dbf3 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:25.347276 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833d727-21b9-4ef1-a281-b5ac0a22dbf3 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:25.347707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833d727-21b9-4ef1-a281-b5ac0a22dbf3 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:25.349453 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 32/62] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:25.354812 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc044f1-eec4-43df-92c5-f9b742f35179 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:25.355962 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc044f1-eec4-43df-92c5-f9b742f35179 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:25.356429 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc044f1-eec4-43df-92c5-f9b742f35179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:25.382748 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-ccc044f1-eec4-43df-92c5-f9b742f35179 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:25.384272 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-ccc044f1-eec4-43df-92c5-f9b742f35179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:25.480968 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 31/63] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:25.523385 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090783d6-dd7d-48ad-98f4-83fc2a6556cf None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:25.524012 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090783d6-dd7d-48ad-98f4-83fc2a6556cf None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:25.524498 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc044f1-eec4-43df-92c5-f9b742f35179 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:25.524705 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090783d6-dd7d-48ad-98f4-83fc2a6556cf None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:25.526283 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 33/64] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:25.531772 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bf462-7a72-46d2-a5a6-40415fd74037 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:25.532307 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bf462-7a72-46d2-a5a6-40415fd74037 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:25.532796 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bf462-7a72-46d2-a5a6-40415fd74037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:25.559120 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-4e3bf462-7a72-46d2-a5a6-40415fd74037 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:25.560376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-4e3bf462-7a72-46d2-a5a6-40415fd74037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:25.607765 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:25.645110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:25.657724 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 34/65] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 17:13:25.659093 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bc04a-6722-4c20-9a53-ff5a488cc93a None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:25.659519 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bc04a-6722-4c20-9a53-ff5a488cc93a None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:25.659909 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bc04a-6722-4c20-9a53-ff5a488cc93a None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:25.661279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 35/66] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:25.673966 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc044f1-eec4-43df-92c5-f9b742f35179 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:25.679564 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17369180-c916-4ee7-b850-2f8ac1d269bf None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:25.680004 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17369180-c916-4ee7-b850-2f8ac1d269bf None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:25.680409 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17369180-c916-4ee7-b850-2f8ac1d269bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:25.698843 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-17369180-c916-4ee7-b850-2f8ac1d269bf None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:25.700398 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-17369180-c916-4ee7-b850-2f8ac1d269bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:25.718748 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc332505-ab16-4f06-9a94-c2ed837704e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:25.719655 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc332505-ab16-4f06-9a94-c2ed837704e9 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:25.719936 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc332505-ab16-4f06-9a94-c2ed837704e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:25.720206 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc332505-ab16-4f06-9a94-c2ed837704e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:25.733033 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc332505-ab16-4f06-9a94-c2ed837704e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:25.742958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-bc332505-ab16-4f06-9a94-c2ed837704e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:13:25.742958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:25.742958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:25.742958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:25.742958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:25.742958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:25.742958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:25.742958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:25.742958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:25.742958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:25.742958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:25.742958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:25.742958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:25.742958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:25.742958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:25.742958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:25.743872 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:25.743872 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:25.743872 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:25.743872 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:25.743872 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:25.743872 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:25.743872 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:25.743872 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:25.743872 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:25.743872 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:25.743872 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:25.743872 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:25.743872 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:25.743872 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:25.743872 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:25.743872 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:25.744628 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:25.744628 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:25.744628 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:25.744628 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:25.744628 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:25.744628 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:25.744628 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:25.744628 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:25.744628 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:25.744628 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:25.744628 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:13:25.744628 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:13:25.744628 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 32/67] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:13:25.745252 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc332505-ab16-4f06-9a94-c2ed837704e9 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:25.780265 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 36/68] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 17:13:25.786756 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17369180-c916-4ee7-b850-2f8ac1d269bf None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:25.855179 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc332505-ab16-4f06-9a94-c2ed837704e9 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:25.880933 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:25.893650 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e151be0-bb32-479e-a2be-03dcbbd0dfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:25.894015 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17369180-c916-4ee7-b850-2f8ac1d269bf None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:25.894464 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e151be0-bb32-479e-a2be-03dcbbd0dfb9 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:25.894776 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e151be0-bb32-479e-a2be-03dcbbd0dfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:25.895053 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e151be0-bb32-479e-a2be-03dcbbd0dfb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:25.903260 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:25.907703 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e151be0-bb32-479e-a2be-03dcbbd0dfb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:25.915697 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-6e151be0-bb32-479e-a2be-03dcbbd0dfb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:13:25.915697 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:25.915697 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:25.915697 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:25.915697 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:25.915697 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:25.915697 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:25.915697 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:25.915697 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:25.915697 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:25.915697 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:25.915697 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:25.915697 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:25.915697 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:25.915697 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:25.915697 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:25.916542 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:25.916542 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:25.916542 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:25.916542 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:25.916542 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:25.916542 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:25.916542 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:25.916542 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:25.916542 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:25.916542 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:25.916542 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:25.916542 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:25.916542 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:25.916542 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:25.916542 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:25.916542 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:25.917305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:25.917305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:25.917305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:25.917305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:25.917305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:25.917305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:25.917305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:25.917305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:25.917305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:25.917305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:25.917305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:13:25.917305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:13:25.917305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 33/69] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 24 17:13:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:13:25.918817 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd610d-d10a-431b-88e8-1a8ac192f0c5 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:25.918817 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd610d-d10a-431b-88e8-1a8ac192f0c5 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:25.918817 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd610d-d10a-431b-88e8-1a8ac192f0c5 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:25.925138 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 34/70] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:25.925138 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd610d-d10a-431b-88e8-1a8ac192f0c5 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:25.939530 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86ce73-b9fa-4081-9684-74afd6094462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:25.940305 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86ce73-b9fa-4081-9684-74afd6094462 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:25.940715 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86ce73-b9fa-4081-9684-74afd6094462 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:25.940999 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86ce73-b9fa-4081-9684-74afd6094462 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:25.941918 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86ce73-b9fa-4081-9684-74afd6094462 None admin] RBAC: Adding query filter params (name=member) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:25.942279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86ce73-b9fa-4081-9684-74afd6094462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:25.943680 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86ce73-b9fa-4081-9684-74afd6094462 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:25.954486 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 37/71] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:13:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:25.955590 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86ce73-b9fa-4081-9684-74afd6094462 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:26.042476 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd610d-d10a-431b-88e8-1a8ac192f0c5 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:26.060729 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86ce73-b9fa-4081-9684-74afd6094462 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:26.077075 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36de91-c884-401c-a004-07f4afb6bb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:26.077891 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36de91-c884-401c-a004-07f4afb6bb50 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:26.078171 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36de91-c884-401c-a004-07f4afb6bb50 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:26.078419 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36de91-c884-401c-a004-07f4afb6bb50 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:26.089250 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36de91-c884-401c-a004-07f4afb6bb50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:26.095383 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902c47b-77fb-404c-ae16-b5ddaa628f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:26.096043 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902c47b-77fb-404c-ae16-b5ddaa628f4d None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:26.096327 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902c47b-77fb-404c-ae16-b5ddaa628f4d None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:26.096604 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902c47b-77fb-404c-ae16-b5ddaa628f4d None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:26.097268 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-fc36de91-c884-401c-a004-07f4afb6bb50 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:13:26.097268 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:26.097268 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:26.097268 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:26.097268 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:26.097268 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:26.097268 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:26.097268 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:26.097268 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:26.097268 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:26.097268 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:26.097268 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:26.097268 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:26.097268 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:26.097268 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:26.097268 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:26.098071 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:26.098071 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:26.098071 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:26.098071 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:26.098071 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:26.098071 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:26.098071 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:26.098071 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:26.098071 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:26.098071 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:26.098071 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:26.098071 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:26.098071 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:26.098071 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:26.098071 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:26.098071 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:26.098850 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:26.098850 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:26.098850 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:26.098850 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:26.098850 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:26.098850 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:26.098850 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:26.098850 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:26.098850 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:26.098850 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:26.098850 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:13:26.098850 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:13:26.099431 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902c47b-77fb-404c-ae16-b5ddaa628f4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:26.099431 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902c47b-77fb-404c-ae16-b5ddaa628f4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:26.099547 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 35/72] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 24 17:13:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:13:26.099608 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902c47b-77fb-404c-ae16-b5ddaa628f4d None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:26.099669 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd08880-bca7-4ece-94de-42d0e3aa9f12 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:26.100060 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd08880-bca7-4ece-94de-42d0e3aa9f12 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:26.100181 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd08880-bca7-4ece-94de-42d0e3aa9f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:26.108046 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 38/73] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:26.108862 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902c47b-77fb-404c-ae16-b5ddaa628f4d None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:26.117040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-5dd08880-bca7-4ece-94de-42d0e3aa9f12 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:26.118230 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-5dd08880-bca7-4ece-94de-42d0e3aa9f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:26.124773 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:26.175479 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:26.186919 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 36/74] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:26.188249 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a9ef3-cdda-4143-9491-6fdd78789830 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:26.188536 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a9ef3-cdda-4143-9491-6fdd78789830 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:26.188814 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a9ef3-cdda-4143-9491-6fdd78789830 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:26.190241 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 37/75] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:26.190788 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a9ef3-cdda-4143-9491-6fdd78789830 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:26.223319 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902c47b-77fb-404c-ae16-b5ddaa628f4d None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:26.257564 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e5673-d63a-40f7-928f-a86705a412d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:26.258465 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e5673-d63a-40f7-928f-a86705a412d7 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:26.258785 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e5673-d63a-40f7-928f-a86705a412d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:26.259037 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e5673-d63a-40f7-928f-a86705a412d7 None admin] PATH_INFO: `/v3/users/3d76b2e90106415987b2b47fc32218a0` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:26.272299 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e5673-d63a-40f7-928f-a86705a412d7 None admin] RBAC: Authorizing `identity:get_user(user_id=3d76b2e90106415987b2b47fc32218a0)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:26.273768 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e5673-d63a-40f7-928f-a86705a412d7 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:26.275458 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 39/76] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:26 2022] GET /identity/v3/users/3d76b2e90106415987b2b47fc32218a0 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:26.276211 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e5673-d63a-40f7-928f-a86705a412d7 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:26.298856 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a9ef3-cdda-4143-9491-6fdd78789830 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:26.332925 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564b0ce-053d-4b15-bbc7-9c295b6d1d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:26.333596 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564b0ce-053d-4b15-bbc7-9c295b6d1d0f None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:26.333879 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564b0ce-053d-4b15-bbc7-9c295b6d1d0f None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:26.334169 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564b0ce-053d-4b15-bbc7-9c295b6d1d0f None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:26.334946 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564b0ce-053d-4b15-bbc7-9c295b6d1d0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:26.335251 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564b0ce-053d-4b15-bbc7-9c295b6d1d0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:26.336645 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564b0ce-053d-4b15-bbc7-9c295b6d1d0f None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:26.343983 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:26.345439 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 38/77] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:13:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:26.346891 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf38d0f-1987-42fd-af05-37386353b074 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:26.347182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf38d0f-1987-42fd-af05-37386353b074 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:26.347464 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf38d0f-1987-42fd-af05-37386353b074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:26.364257 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-0bf38d0f-1987-42fd-af05-37386353b074 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:26.365438 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-0bf38d0f-1987-42fd-af05-37386353b074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:26.378583 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e5673-d63a-40f7-928f-a86705a412d7 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:26.415223 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:26.415528 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b203e05-0599-4252-9da5-b48abda1f812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:26.416413 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b203e05-0599-4252-9da5-b48abda1f812 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:26.416697 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b203e05-0599-4252-9da5-b48abda1f812 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:26.416972 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b203e05-0599-4252-9da5-b48abda1f812 None admin] PATH_INFO: `/v3/users/f9689251030946e8ba0417a0a5385957` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:26.418170 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b203e05-0599-4252-9da5-b48abda1f812 None admin] RBAC: Authorizing `identity:get_user(user_id=f9689251030946e8ba0417a0a5385957)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:26.419970 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b203e05-0599-4252-9da5-b48abda1f812 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:26.421620 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 40/78] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:26 2022] GET /identity/v3/users/f9689251030946e8ba0417a0a5385957 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:26.422383 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b203e05-0599-4252-9da5-b48abda1f812 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:26.435800 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 39/79] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:26.436569 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf38d0f-1987-42fd-af05-37386353b074 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:26.530044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b203e05-0599-4252-9da5-b48abda1f812 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:26.536065 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf38d0f-1987-42fd-af05-37386353b074 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:26.563670 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06e9f6-207b-49ae-9d0c-049eaa3efdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:26.564478 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06e9f6-207b-49ae-9d0c-049eaa3efdea None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:26.564759 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06e9f6-207b-49ae-9d0c-049eaa3efdea None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:26.565031 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06e9f6-207b-49ae-9d0c-049eaa3efdea None admin] PATH_INFO: `/v3/roles/member` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:26.568747 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efdc1e6-c78f-4c44-8969-bf112a4267f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:26.569393 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdc1e6-c78f-4c44-8969-bf112a4267f8 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:26.569670 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdc1e6-c78f-4c44-8969-bf112a4267f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:26.569942 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdc1e6-c78f-4c44-8969-bf112a4267f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:26.571807 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:26.575517 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06e9f6-207b-49ae-9d0c-049eaa3efdea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:26.583911 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-ca06e9f6-207b-49ae-9d0c-049eaa3efdea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:13:26.583911 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:26.583911 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:26.583911 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:26.583911 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:26.583911 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:26.583911 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:26.583911 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:26.583911 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:26.583911 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:26.583911 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:26.583911 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:26.583911 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:26.583911 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:26.583911 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:26.583911 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:26.584819 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:26.584819 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:26.584819 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:26.584819 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:26.584819 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:26.584819 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:26.584819 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:26.584819 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:26.584819 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:26.584819 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:26.584819 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:26.584819 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:26.584819 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:26.584819 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:26.584819 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:26.584819 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:26.590633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:26.590633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:26.590633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:26.590633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:26.590633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:26.590633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:26.590633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:26.590633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:26.590633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:26.590633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:26.590633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:13:26.590633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:13:26.590633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 41/80] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:13:26.590633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06e9f6-207b-49ae-9d0c-049eaa3efdea None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:26.619951 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:26.639160 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efdc1e6-c78f-4c44-8969-bf112a4267f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:26.641059 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efdc1e6-c78f-4c44-8969-bf112a4267f8 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:26.684596 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06e9f6-207b-49ae-9d0c-049eaa3efdea None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:26.718463 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86421688-87d4-4fec-bdec-2e8fd8a6d7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:26.719289 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86421688-87d4-4fec-bdec-2e8fd8a6d7d9 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:26.719561 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86421688-87d4-4fec-bdec-2e8fd8a6d7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:26.719828 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86421688-87d4-4fec-bdec-2e8fd8a6d7d9 None admin] PATH_INFO: `/v3/users/3d76b2e90106415987b2b47fc32218a0` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:26.721046 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86421688-87d4-4fec-bdec-2e8fd8a6d7d9 None admin] RBAC: Authorizing `identity:get_user(user_id=3d76b2e90106415987b2b47fc32218a0)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:26.722510 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86421688-87d4-4fec-bdec-2e8fd8a6d7d9 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:26.724319 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 42/81] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:26 2022] GET /identity/v3/users/3d76b2e90106415987b2b47fc32218a0 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:26.724991 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86421688-87d4-4fec-bdec-2e8fd8a6d7d9 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:26.741982 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 40/82] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:13:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:13:26.742846 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efdc1e6-c78f-4c44-8969-bf112a4267f8 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:26.789516 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:26.824601 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86421688-87d4-4fec-bdec-2e8fd8a6d7d9 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:26.824983 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:26.844451 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efdc1e6-c78f-4c44-8969-bf112a4267f8 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:26.858493 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00b1de-8f67-46c1-a77f-0357dfa52722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:26.859163 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00b1de-8f67-46c1-a77f-0357dfa52722 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:26.859436 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00b1de-8f67-46c1-a77f-0357dfa52722 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:26.859706 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00b1de-8f67-46c1-a77f-0357dfa52722 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:26.878647 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453700f5-91dd-4b3b-9e83-6912086d0225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:26.879442 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453700f5-91dd-4b3b-9e83-6912086d0225 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:26.879724 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453700f5-91dd-4b3b-9e83-6912086d0225 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:26.879994 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453700f5-91dd-4b3b-9e83-6912086d0225 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:26.881175 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453700f5-91dd-4b3b-9e83-6912086d0225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:26.882672 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453700f5-91dd-4b3b-9e83-6912086d0225 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:26.884507 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 41/83] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:13:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:26.885051 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453700f5-91dd-4b3b-9e83-6912086d0225 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:26.929764 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00b1de-8f67-46c1-a77f-0357dfa52722 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:26.931265 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00b1de-8f67-46c1-a77f-0357dfa52722 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:26.984415 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453700f5-91dd-4b3b-9e83-6912086d0225 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:26.995207 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:27.018496 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd89b9-d115-4275-88b1-c28a8e1d9d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:27.019213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd89b9-d115-4275-88b1-c28a8e1d9d90 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:27.019499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd89b9-d115-4275-88b1-c28a8e1d9d90 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:27.019739 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd89b9-d115-4275-88b1-c28a8e1d9d90 None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:27.020489 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd89b9-d115-4275-88b1-c28a8e1d9d90 None admin] RBAC: Adding query filter params (name=member) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:27.020801 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd89b9-d115-4275-88b1-c28a8e1d9d90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:27.022237 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd89b9-d115-4275-88b1-c28a8e1d9d90 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:27.031382 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 42/84] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:13:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:27.032193 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd89b9-d115-4275-88b1-c28a8e1d9d90 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:27.033057 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 43/85] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:13:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:13:27.033828 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00b1de-8f67-46c1-a77f-0357dfa52722 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:27.049784 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:27.132973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd89b9-d115-4275-88b1-c28a8e1d9d90 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:27.136300 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00b1de-8f67-46c1-a77f-0357dfa52722 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:27.167574 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de31269-3f73-4ee3-a712-5a6564c1e148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:27.168225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de31269-3f73-4ee3-a712-5a6564c1e148 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:27.168501 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de31269-3f73-4ee3-a712-5a6564c1e148 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:27.168778 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de31269-3f73-4ee3-a712-5a6564c1e148 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:27.175449 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352ba88-b110-4d99-973c-e1a54552e55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:27.176319 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352ba88-b110-4d99-973c-e1a54552e55d None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:27.176605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352ba88-b110-4d99-973c-e1a54552e55d None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:27.176882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352ba88-b110-4d99-973c-e1a54552e55d None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:27.178443 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352ba88-b110-4d99-973c-e1a54552e55d None admin] RBAC: Authorizing `identity:get_project(project_id=20fbbdffa9b84d99b150f2395751706c)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:27.179950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352ba88-b110-4d99-973c-e1a54552e55d None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:27.181656 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 44/86] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:27 2022] GET /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:27.182402 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352ba88-b110-4d99-973c-e1a54552e55d None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:27.220029 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:27.238226 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de31269-3f73-4ee3-a712-5a6564c1e148 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:27.239678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de31269-3f73-4ee3-a712-5a6564c1e148 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:27.253165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:27.286753 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352ba88-b110-4d99-973c-e1a54552e55d None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:27.319674 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7210bb2-ea0b-4419-b3ff-cfd8d8099fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:27.320342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7210bb2-ea0b-4419-b3ff-cfd8d8099fec None admin] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:27.320622 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7210bb2-ea0b-4419-b3ff-cfd8d8099fec None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:27.320895 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7210bb2-ea0b-4419-b3ff-cfd8d8099fec None admin] PATH_INFO: `/v3/users` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:27.321595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7210bb2-ea0b-4419-b3ff-cfd8d8099fec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:27.323331 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7210bb2-ea0b-4419-b3ff-cfd8d8099fec None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:27.335559 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 43/87] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:13:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:13:27.336483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de31269-3f73-4ee3-a712-5a6564c1e148 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:27.354658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 45/88] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 24 17:13:27 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:13:27.356345 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7210bb2-ea0b-4419-b3ff-cfd8d8099fec None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:27.455223 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de31269-3f73-4ee3-a712-5a6564c1e148 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:27.464948 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:27.472535 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:27.478954 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7210bb2-ea0b-4419-b3ff-cfd8d8099fec None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:27.498235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197db1f-1840-4e9c-ae3e-b32b3862144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:27.499093 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197db1f-1840-4e9c-ae3e-b32b3862144c None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:27.499417 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197db1f-1840-4e9c-ae3e-b32b3862144c None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:27.499693 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197db1f-1840-4e9c-ae3e-b32b3862144c None admin] PATH_INFO: `/v3/users/3d76b2e90106415987b2b47fc32218a0` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:27.501181 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197db1f-1840-4e9c-ae3e-b32b3862144c None admin] RBAC: Authorizing `identity:get_user(user_id=3d76b2e90106415987b2b47fc32218a0)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:27.502743 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197db1f-1840-4e9c-ae3e-b32b3862144c None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:27.509184 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 44/89] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:27 2022] GET /identity/v3/users/3d76b2e90106415987b2b47fc32218a0 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:27.509184 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197db1f-1840-4e9c-ae3e-b32b3862144c None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:27.536939 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc173c-be27-41a1-add1-41e4e647993b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:27.537930 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc173c-be27-41a1-add1-41e4e647993b None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:27.538215 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc173c-be27-41a1-add1-41e4e647993b None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:27.538488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc173c-be27-41a1-add1-41e4e647993b None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:27.539973 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc173c-be27-41a1-add1-41e4e647993b None admin] RBAC: Authorizing `identity:get_project(project_id=20fbbdffa9b84d99b150f2395751706c)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:27.541499 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc173c-be27-41a1-add1-41e4e647993b None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:27.548162 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 46/90] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:27 2022] GET /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:27.548162 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc173c-be27-41a1-add1-41e4e647993b None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:27.628752 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197db1f-1840-4e9c-ae3e-b32b3862144c None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:27.666983 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc173c-be27-41a1-add1-41e4e647993b None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:27.676639 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5f37f-cf00-491c-89df-7e9cf501d0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:27.677308 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5f37f-cf00-491c-89df-7e9cf501d0d5 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:27.677584 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5f37f-cf00-491c-89df-7e9cf501d0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:27.677857 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5f37f-cf00-491c-89df-7e9cf501d0d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:27.678807 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5f37f-cf00-491c-89df-7e9cf501d0d5 None admin] RBAC: Adding query filter params (role.id=ee8d50c25f9347d5b99d4a346f7c2fa8, scope.project.id=20fbbdffa9b84d99b150f2395751706c, user.id=3d76b2e90106415987b2b47fc32218a0) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:27.679113 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5f37f-cf00-491c-89df-7e9cf501d0d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:27.680599 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5f37f-cf00-491c-89df-7e9cf501d0d5 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:27.687842 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 45/91] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:13:27 2022] GET /identity/v3/role_assignments?user.id=3d76b2e90106415987b2b47fc32218a0&scope.project.id=20fbbdffa9b84d99b150f2395751706c&role.id=ee8d50c25f9347d5b99d4a346f7c2fa8 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:27.688448 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5f37f-cf00-491c-89df-7e9cf501d0d5 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:27.719107 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a02df-dc0c-42b6-8604-087e64039735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:27.720133 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a02df-dc0c-42b6-8604-087e64039735 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:27.720410 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a02df-dc0c-42b6-8604-087e64039735 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:27.720686 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a02df-dc0c-42b6-8604-087e64039735 None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:27.724328 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a02df-dc0c-42b6-8604-087e64039735 None admin] RBAC: Authorizing `identity:get_project(project_id=20fbbdffa9b84d99b150f2395751706c)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:27.728059 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a02df-dc0c-42b6-8604-087e64039735 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:27.731999 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 47/92] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:27 2022] GET /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:27.733297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a02df-dc0c-42b6-8604-087e64039735 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:27.760941 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:27.775011 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:27.841867 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5f37f-cf00-491c-89df-7e9cf501d0d5 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:27.862284 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a02df-dc0c-42b6-8604-087e64039735 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:27.888370 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca5e96-041f-438a-9606-53d38cf81014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:27.889295 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca5e96-041f-438a-9606-53d38cf81014 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:27.889973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca5e96-041f-438a-9606-53d38cf81014 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:27.890409 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca5e96-041f-438a-9606-53d38cf81014 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:27.914114 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea23cb6-56b6-4b35-9f20-670bb29232a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:27.914852 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea23cb6-56b6-4b35-9f20-670bb29232a5 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:27.915143 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea23cb6-56b6-4b35-9f20-670bb29232a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:27.915416 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea23cb6-56b6-4b35-9f20-670bb29232a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:27.916971 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea23cb6-56b6-4b35-9f20-670bb29232a5 None admin] RBAC: Adding query filter params (role.id=ae295b7c396a4e559ecd6d574f097d4a, scope.project.id=20fbbdffa9b84d99b150f2395751706c, user.id=f9689251030946e8ba0417a0a5385957) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:27.917290 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea23cb6-56b6-4b35-9f20-670bb29232a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:27.918810 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea23cb6-56b6-4b35-9f20-670bb29232a5 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:27.931640 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 48/93] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:13:27 2022] GET /identity/v3/role_assignments?user.id=f9689251030946e8ba0417a0a5385957&scope.project.id=20fbbdffa9b84d99b150f2395751706c&role.id=ae295b7c396a4e559ecd6d574f097d4a => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:27.932358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea23cb6-56b6-4b35-9f20-670bb29232a5 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:28.068803 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca5e96-041f-438a-9606-53d38cf81014 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:28.070309 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca5e96-041f-438a-9606-53d38cf81014 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:28.121807 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:28.146790 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea23cb6-56b6-4b35-9f20-670bb29232a5 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:28.185996 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:28.221228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577b746-3a6e-4b8e-bf1b-53ee25b58200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:28.222006 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577b746-3a6e-4b8e-bf1b-53ee25b58200 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:28.222293 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577b746-3a6e-4b8e-bf1b-53ee25b58200 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:28.222587 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577b746-3a6e-4b8e-bf1b-53ee25b58200 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:28.223440 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577b746-3a6e-4b8e-bf1b-53ee25b58200 None admin] RBAC: Adding query filter params (role.id=bbc0c8e77a594880a35aae1d21773668, scope.project.id=20fbbdffa9b84d99b150f2395751706c, user.id=3d76b2e90106415987b2b47fc32218a0) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:28.223752 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577b746-3a6e-4b8e-bf1b-53ee25b58200 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:28.225225 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577b746-3a6e-4b8e-bf1b-53ee25b58200 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:28.232479 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 49/94] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:13:27 2022] GET /identity/v3/role_assignments?user.id=3d76b2e90106415987b2b47fc32218a0&scope.project.id=20fbbdffa9b84d99b150f2395751706c&role.id=bbc0c8e77a594880a35aae1d21773668 => generated 259 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:28.306715 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 46/95] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:13:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:13:28.312756 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577b746-3a6e-4b8e-bf1b-53ee25b58200 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:28.490137 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577b746-3a6e-4b8e-bf1b-53ee25b58200 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:28.529289 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14df34-a567-407a-a27a-e8f8a126200b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:28.530174 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14df34-a567-407a-a27a-e8f8a126200b None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:28.530459 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14df34-a567-407a-a27a-e8f8a126200b None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:28.530824 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14df34-a567-407a-a27a-e8f8a126200b None admin] PATH_INFO: `/v3/projects/06d50bf5f7074d4ab6784ffaf232bbfc` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:28.532013 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14df34-a567-407a-a27a-e8f8a126200b None admin] RBAC: Authorizing `identity:get_project(project_id=06d50bf5f7074d4ab6784ffaf232bbfc)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:28.533475 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14df34-a567-407a-a27a-e8f8a126200b None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:28.535396 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 50/96] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:28 2022] GET /identity/v3/projects/06d50bf5f7074d4ab6784ffaf232bbfc => generated 312 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:28.541313 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca5e96-041f-438a-9606-53d38cf81014 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:28.698076 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca5e96-041f-438a-9606-53d38cf81014 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:28.748803 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821263b-c5ef-4135-a2c9-c1c1f8dc341f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:28.749471 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821263b-c5ef-4135-a2c9-c1c1f8dc341f None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:28.749748 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821263b-c5ef-4135-a2c9-c1c1f8dc341f None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:28.750019 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821263b-c5ef-4135-a2c9-c1c1f8dc341f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:28.750896 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821263b-c5ef-4135-a2c9-c1c1f8dc341f None admin] RBAC: Adding query filter params (role.id=ee8d50c25f9347d5b99d4a346f7c2fa8, scope.project.id=06d50bf5f7074d4ab6784ffaf232bbfc, user.id=3d76b2e90106415987b2b47fc32218a0) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:28.751203 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821263b-c5ef-4135-a2c9-c1c1f8dc341f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:28.752662 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821263b-c5ef-4135-a2c9-c1c1f8dc341f None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:28.761376 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 47/97] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:13:28 2022] GET /identity/v3/role_assignments?user.id=3d76b2e90106415987b2b47fc32218a0&scope.project.id=06d50bf5f7074d4ab6784ffaf232bbfc&role.id=ee8d50c25f9347d5b99d4a346f7c2fa8 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:30.852846 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79b4ee-846c-4c93-be67-6e29a186be81 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:30.853919 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79b4ee-846c-4c93-be67-6e29a186be81 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:30.854429 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79b4ee-846c-4c93-be67-6e29a186be81 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:30.856892 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 51/98] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:30.862940 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bc65c-4317-415b-84d2-68a783019cbb None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:30.863477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bc65c-4317-415b-84d2-68a783019cbb None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:30.863477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bc65c-4317-415b-84d2-68a783019cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:30.883661 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-6e6bc65c-4317-415b-84d2-68a783019cbb None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:30.884922 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-6e6bc65c-4317-415b-84d2-68a783019cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:30.887258 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:30.980488 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 48/99] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:30.999438 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f583a12-419c-4732-b5ae-93a894faa598 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:30.999742 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f583a12-419c-4732-b5ae-93a894faa598 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:30.999989 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f583a12-419c-4732-b5ae-93a894faa598 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:31.001346 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 52/100] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:31.006987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd15658-118b-440e-a6f9-5f2679d1b2f0 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:31.007277 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd15658-118b-440e-a6f9-5f2679d1b2f0 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:31.007590 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd15658-118b-440e-a6f9-5f2679d1b2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:31.021686 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f583a12-419c-4732-b5ae-93a894faa598 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:31.034106 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-8fd15658-118b-440e-a6f9-5f2679d1b2f0 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:31.035354 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-8fd15658-118b-440e-a6f9-5f2679d1b2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:31.098943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:31.169163 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 49/101] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:31.202748 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a84f6-783c-4212-ad77-de80b6e17868 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:31.202953 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a84f6-783c-4212-ad77-de80b6e17868 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:31.203151 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a84f6-783c-4212-ad77-de80b6e17868 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:31.204600 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 50/102] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:31.209941 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc27384-2ce3-464a-be08-c435c984b4b9 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:31.210225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc27384-2ce3-464a-be08-c435c984b4b9 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:31.210508 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc27384-2ce3-464a-be08-c435c984b4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:31.245768 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-edc27384-2ce3-464a-be08-c435c984b4b9 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:31.247740 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-edc27384-2ce3-464a-be08-c435c984b4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:31.265549 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f583a12-419c-4732-b5ae-93a894faa598 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:31.308515 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d86f6-9b29-4475-a930-e51f44a4fad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:31.309727 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d86f6-9b29-4475-a930-e51f44a4fad0 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:31.310604 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d86f6-9b29-4475-a930-e51f44a4fad0 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:31.311043 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d86f6-9b29-4475-a930-e51f44a4fad0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:31.312641 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d86f6-9b29-4475-a930-e51f44a4fad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:31.314992 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d86f6-9b29-4475-a930-e51f44a4fad0 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:31.317680 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 53/103] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:13:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:13:31.318820 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d86f6-9b29-4475-a930-e51f44a4fad0 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:31.319375 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:31.327567 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 51/104] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 17:13:31.334590 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ccf90-a539-4fe5-a7e6-5da7c91ecee4 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:31.334590 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ccf90-a539-4fe5-a7e6-5da7c91ecee4 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:31.334590 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ccf90-a539-4fe5-a7e6-5da7c91ecee4 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:31.335698 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 52/105] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:31.336008 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ccf90-a539-4fe5-a7e6-5da7c91ecee4 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:31.437869 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:31.449431 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d86f6-9b29-4475-a930-e51f44a4fad0 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:31.455680 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ccf90-a539-4fe5-a7e6-5da7c91ecee4 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:31.489473 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4261b3-3591-455d-b64c-856a4cbc3417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:31.490745 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4261b3-3591-455d-b64c-856a4cbc3417 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:31.491230 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4261b3-3591-455d-b64c-856a4cbc3417 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:31.491738 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4261b3-3591-455d-b64c-856a4cbc3417 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:31.495369 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecaeb0-e733-432a-b9bd-5923f506af08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:31.496105 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecaeb0-e733-432a-b9bd-5923f506af08 None admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:31.496443 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecaeb0-e733-432a-b9bd-5923f506af08 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:31.496805 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecaeb0-e733-432a-b9bd-5923f506af08 None admin] PATH_INFO: `/v3/projects` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:31.497902 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecaeb0-e733-432a-b9bd-5923f506af08 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:31.499555 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecaeb0-e733-432a-b9bd-5923f506af08 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:31.504421 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4261b3-3591-455d-b64c-856a4cbc3417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:31.513005 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-6f4261b3-3591-455d-b64c-856a4cbc3417 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 17:13:31.513005 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:31.513005 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:31.513005 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:31.513005 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:31.513005 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:31.513005 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:31.513005 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:31.513005 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:31.513005 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:31.513005 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:31.513005 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:31.513005 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:31.513005 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:31.513005 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:31.513005 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:31.513937 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:31.513937 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:31.513937 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:31.513937 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:31.513937 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:31.513937 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:31.513937 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:31.513937 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:31.513937 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:31.513937 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:31.513937 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:31.513937 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:31.513937 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:31.513937 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:31.513937 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:31.513937 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:31.514749 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:31.514749 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:31.514749 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:31.514749 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:31.514749 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:31.514749 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:31.514749 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:31.514749 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:31.514749 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:31.514749 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:31.514749 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 17:13:31.514749 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:13:31.517261 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 54/106] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:13:31.523442 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece2e94-5f37-4743-b7c4-ac8c2dfc7b0b None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:31.523949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece2e94-5f37-4743-b7c4-ac8c2dfc7b0b None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:31.524439 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece2e94-5f37-4743-b7c4-ac8c2dfc7b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:31.532033 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 53/107] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 24 17:13:31 2022] POST /identity/v3/projects => generated 302 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:13:31.532980 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecaeb0-e733-432a-b9bd-5923f506af08 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:31.542974 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-4ece2e94-5f37-4743-b7c4-ac8c2dfc7b0b None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:31.544618 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-4ece2e94-5f37-4743-b7c4-ac8c2dfc7b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:31.593268 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:31.618085 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 55/108] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:31.619395 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece2e94-5f37-4743-b7c4-ac8c2dfc7b0b None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:31.663670 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecaeb0-e733-432a-b9bd-5923f506af08 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:31.703545 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bd988-eb1b-49c1-85b6-75ea354c9fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:31.704288 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bd988-eb1b-49c1-85b6-75ea354c9fbc None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:31.704564 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bd988-eb1b-49c1-85b6-75ea354c9fbc None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:31.704871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bd988-eb1b-49c1-85b6-75ea354c9fbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:31.706425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:31.719118 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7bd988-eb1b-49c1-85b6-75ea354c9fbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:31.726987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-7c7bd988-eb1b-49c1-85b6-75ea354c9fbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:13:31.726987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:31.726987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:31.726987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:31.726987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:31.726987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:31.726987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:31.726987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:31.726987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:31.726987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:31.726987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:31.726987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:31.726987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:31.726987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:31.726987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:31.726987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:31.727916 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:31.727916 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:31.727916 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:31.727916 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:31.727916 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:31.727916 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:31.727916 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:31.727916 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:31.727916 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:31.727916 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:31.727916 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:31.727916 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:31.727916 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:31.727916 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:31.727916 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:31.727916 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:31.728705 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:31.728705 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:31.728705 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:31.728705 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:31.728705 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:31.728705 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:31.728705 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:31.728705 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:31.728705 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:31.728705 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:31.728705 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:13:31.728705 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:13:31.730617 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece2e94-5f37-4743-b7c4-ac8c2dfc7b0b None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:31.734611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 54/109] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:13:31.735096 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bd988-eb1b-49c1-85b6-75ea354c9fbc None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:31.785197 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1edac-cc2e-472a-a01a-3efefd770303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:31.786862 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1edac-cc2e-472a-a01a-3efefd770303 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:31.787282 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1edac-cc2e-472a-a01a-3efefd770303 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:31.787703 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1edac-cc2e-472a-a01a-3efefd770303 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:31.789272 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1edac-cc2e-472a-a01a-3efefd770303 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:31.789728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1edac-cc2e-472a-a01a-3efefd770303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:31.792051 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1edac-cc2e-472a-a01a-3efefd770303 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:31.804796 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 56/110] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:13:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:31.806180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1edac-cc2e-472a-a01a-3efefd770303 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:31.867259 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bd988-eb1b-49c1-85b6-75ea354c9fbc None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:31.885670 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:31.922120 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdaa2aa-2b3b-4ea8-ba57-a62a2c563dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:31.923323 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdaa2aa-2b3b-4ea8-ba57-a62a2c563dcb None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:31.923605 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdaa2aa-2b3b-4ea8-ba57-a62a2c563dcb None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:31.924248 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdaa2aa-2b3b-4ea8-ba57-a62a2c563dcb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:31.939281 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdaa2aa-2b3b-4ea8-ba57-a62a2c563dcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:31.946949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1edac-cc2e-472a-a01a-3efefd770303 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:31.947405 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-6fdaa2aa-2b3b-4ea8-ba57-a62a2c563dcb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:13:31.947405 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:31.947405 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:31.947405 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:31.947405 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:31.947405 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:31.947405 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:31.947405 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:31.947405 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:31.947405 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:31.947405 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:31.947405 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:31.947405 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:31.947405 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:31.947405 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:31.947405 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:31.948182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:31.948182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:31.948182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:31.948182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:31.948182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:31.948182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:31.948182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:31.948182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:31.948182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:31.948182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:31.948182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:31.948182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:31.948182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:31.948182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:31.948182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:31.948182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:31.950801 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:31.950801 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:31.950801 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:31.950801 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:31.950801 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:31.950801 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:31.950801 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:31.950801 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:31.950801 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:31.950801 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:31.950801 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:13:31.950801 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:13:31.950801 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 55/111] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 24 17:13:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:13:31.950801 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdaa2aa-2b3b-4ea8-ba57-a62a2c563dcb None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:31.989022 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab75fdd-8499-4550-994c-f1045535b7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:31.989589 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab75fdd-8499-4550-994c-f1045535b7e9 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:31.989869 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab75fdd-8499-4550-994c-f1045535b7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:31.990140 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab75fdd-8499-4550-994c-f1045535b7e9 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:31.992062 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab75fdd-8499-4550-994c-f1045535b7e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:31.992062 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab75fdd-8499-4550-994c-f1045535b7e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:31.992568 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab75fdd-8499-4550-994c-f1045535b7e9 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:32.004895 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 57/112] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:13:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:32.009990 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3114a-f08c-40b9-b574-327525b0abae None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:32.010605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3114a-f08c-40b9-b574-327525b0abae None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:32.010847 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3114a-f08c-40b9-b574-327525b0abae None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:32.012770 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 58/113] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:32.015651 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3114a-f08c-40b9-b574-327525b0abae None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:32.019155 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:32.093130 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdaa2aa-2b3b-4ea8-ba57-a62a2c563dcb None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:32.127066 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3114a-f08c-40b9-b574-327525b0abae None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:32.134482 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78ee35-7c14-4918-9370-035b10aa24fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:32.135587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78ee35-7c14-4918-9370-035b10aa24fc None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:32.135865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78ee35-7c14-4918-9370-035b10aa24fc None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:32.136136 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78ee35-7c14-4918-9370-035b10aa24fc None admin] PATH_INFO: `/v3/users/a2dc6fa37c7a42b49c96f32fe3622bb4` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:32.152364 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78ee35-7c14-4918-9370-035b10aa24fc None admin] RBAC: Authorizing `identity:get_user(user_id=a2dc6fa37c7a42b49c96f32fe3622bb4)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:32.154192 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78ee35-7c14-4918-9370-035b10aa24fc None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:32.156267 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 56/114] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:31 2022] GET /identity/v3/users/a2dc6fa37c7a42b49c96f32fe3622bb4 => generated 289 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:32.157361 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2988b-9e3d-4342-9e2c-3f07b0885db5 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:32.157647 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2988b-9e3d-4342-9e2c-3f07b0885db5 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:32.157923 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2988b-9e3d-4342-9e2c-3f07b0885db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:32.169231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574eea2-85b4-439d-9e05-e17d474b6cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:32.169902 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574eea2-85b4-439d-9e05-e17d474b6cef None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:32.170180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574eea2-85b4-439d-9e05-e17d474b6cef None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:32.170449 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574eea2-85b4-439d-9e05-e17d474b6cef None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:32.171226 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574eea2-85b4-439d-9e05-e17d474b6cef None admin] RBAC: Adding query filter params (name=admin) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:32.171525 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574eea2-85b4-439d-9e05-e17d474b6cef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:32.172897 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574eea2-85b4-439d-9e05-e17d474b6cef None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:32.174588 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-f2d2988b-9e3d-4342-9e2c-3f07b0885db5 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:32.175765 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-f2d2988b-9e3d-4342-9e2c-3f07b0885db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:32.182342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 59/115] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:32.183426 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574eea2-85b4-439d-9e05-e17d474b6cef None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:32.202313 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:32.250107 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 57/116] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:32.251732 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26757a8b-4712-4180-a68c-84c4ec75c371 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:32.252022 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26757a8b-4712-4180-a68c-84c4ec75c371 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:32.252352 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26757a8b-4712-4180-a68c-84c4ec75c371 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:32.253810 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 58/117] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:32.258405 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26757a8b-4712-4180-a68c-84c4ec75c371 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:32.266341 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:32.315797 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574eea2-85b4-439d-9e05-e17d474b6cef None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:32.356061 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417f703-a2bc-4d2d-9a8f-996ee4bdfc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:32.356952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417f703-a2bc-4d2d-9a8f-996ee4bdfc90 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:32.357236 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417f703-a2bc-4d2d-9a8f-996ee4bdfc90 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:32.357511 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417f703-a2bc-4d2d-9a8f-996ee4bdfc90 None admin] PATH_INFO: `/v3/users/3d76b2e90106415987b2b47fc32218a0` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:32.358769 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417f703-a2bc-4d2d-9a8f-996ee4bdfc90 None admin] RBAC: Authorizing `identity:get_user(user_id=3d76b2e90106415987b2b47fc32218a0)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:32.360239 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417f703-a2bc-4d2d-9a8f-996ee4bdfc90 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:32.366217 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26757a8b-4712-4180-a68c-84c4ec75c371 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:32.366999 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 60/118] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:32 2022] GET /identity/v3/users/3d76b2e90106415987b2b47fc32218a0 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:32.367801 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417f703-a2bc-4d2d-9a8f-996ee4bdfc90 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:32.404684 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cdef6-06ef-448d-b955-794561b0b234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:32.405341 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cdef6-06ef-448d-b955-794561b0b234 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:32.405620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cdef6-06ef-448d-b955-794561b0b234 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:32.405891 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cdef6-06ef-448d-b955-794561b0b234 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:32.435371 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:32.471338 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417f703-a2bc-4d2d-9a8f-996ee4bdfc90 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:32.481560 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2cdef6-06ef-448d-b955-794561b0b234 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:32.483102 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2cdef6-06ef-448d-b955-794561b0b234 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:32.507177 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1a96c-bf2d-44cd-9bff-10e610634419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:32.507986 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1a96c-bf2d-44cd-9bff-10e610634419 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:32.508264 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1a96c-bf2d-44cd-9bff-10e610634419 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:32.508540 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1a96c-bf2d-44cd-9bff-10e610634419 None admin] PATH_INFO: `/v3/users/f9689251030946e8ba0417a0a5385957` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:32.509730 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1a96c-bf2d-44cd-9bff-10e610634419 None admin] RBAC: Authorizing `identity:get_user(user_id=f9689251030946e8ba0417a0a5385957)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:32.511231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1a96c-bf2d-44cd-9bff-10e610634419 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:32.517657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 61/119] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:32 2022] GET /identity/v3/users/f9689251030946e8ba0417a0a5385957 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:32.517657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a913e1-8031-4392-992f-99ff7a168360 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:32.517657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a913e1-8031-4392-992f-99ff7a168360 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:32.517657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a913e1-8031-4392-992f-99ff7a168360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:32.519803 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:32.532706 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-61a913e1-8031-4392-992f-99ff7a168360 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:32.533900 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-61a913e1-8031-4392-992f-99ff7a168360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:32.595157 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 59/120] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:13:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:13:32.596008 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cdef6-06ef-448d-b955-794561b0b234 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:32.609688 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 62/121] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:32.619636 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a913e1-8031-4392-992f-99ff7a168360 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:32.668894 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:32.716222 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cdef6-06ef-448d-b955-794561b0b234 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:32.736241 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a913e1-8031-4392-992f-99ff7a168360 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:32.752424 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efc793-b49f-4e4e-9c36-2c2a97ccd3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:32.753192 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efc793-b49f-4e4e-9c36-2c2a97ccd3ac None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:32.753478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efc793-b49f-4e4e-9c36-2c2a97ccd3ac None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:32.753758 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efc793-b49f-4e4e-9c36-2c2a97ccd3ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:32.764797 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77efc793-b49f-4e4e-9c36-2c2a97ccd3ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:32.768097 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:32.773303 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-77efc793-b49f-4e4e-9c36-2c2a97ccd3ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:13:32.773303 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:32.773303 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:32.773303 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:32.773303 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:32.773303 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:32.773303 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:32.773303 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:32.773303 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:32.773303 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:32.773303 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:32.773303 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:32.773303 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:32.773303 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:32.773303 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:32.773303 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:32.774130 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:32.774130 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:32.774130 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:32.774130 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:32.774130 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:32.774130 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:32.774130 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:32.774130 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:32.774130 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:32.774130 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:32.774130 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:32.774130 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:32.774130 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:32.774130 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:32.774130 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:32.774130 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:32.775077 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:32.775077 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:32.775077 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:32.775077 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:32.775077 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:32.775077 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:32.775077 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:32.775077 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:32.775077 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:32.775077 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:32.775077 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:13:32.775077 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:13:32.775077 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 60/122] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 24 17:13:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:13:32.775990 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2df12e-7cf8-44b1-99c0-e8086be092ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:32.777133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efc793-b49f-4e4e-9c36-2c2a97ccd3ac None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:32.778464 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2df12e-7cf8-44b1-99c0-e8086be092ff None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:32.778771 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2df12e-7cf8-44b1-99c0-e8086be092ff None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:32.779029 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2df12e-7cf8-44b1-99c0-e8086be092ff None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:32.780699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2df12e-7cf8-44b1-99c0-e8086be092ff None admin] RBAC: Authorizing `identity:get_project(project_id=20fbbdffa9b84d99b150f2395751706c)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:32.782366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2df12e-7cf8-44b1-99c0-e8086be092ff None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:32.784117 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 63/123] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:32 2022] GET /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:32.784942 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2df12e-7cf8-44b1-99c0-e8086be092ff None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:32.883832 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efc793-b49f-4e4e-9c36-2c2a97ccd3ac None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:32.892249 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2df12e-7cf8-44b1-99c0-e8086be092ff None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:32.902551 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:32.923655 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233a9aa-7bda-4db5-a21a-65dbca509701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:32.925064 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233a9aa-7bda-4db5-a21a-65dbca509701 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:32.925347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233a9aa-7bda-4db5-a21a-65dbca509701 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:32.925621 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233a9aa-7bda-4db5-a21a-65dbca509701 None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:32.926838 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233a9aa-7bda-4db5-a21a-65dbca509701 None admin] RBAC: Authorizing `identity:get_project(project_id=20fbbdffa9b84d99b150f2395751706c)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:32.928291 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233a9aa-7bda-4db5-a21a-65dbca509701 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:32.928628 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f0772-d748-4389-997f-1fb6c6a7bdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:32.929496 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f0772-d748-4389-997f-1fb6c6a7bdae None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:32.929778 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f0772-d748-4389-997f-1fb6c6a7bdae None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:32.930238 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 61/124] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:32 2022] GET /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:32.930698 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f0772-d748-4389-997f-1fb6c6a7bdae None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:32.930805 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233a9aa-7bda-4db5-a21a-65dbca509701 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:32.932338 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f0772-d748-4389-997f-1fb6c6a7bdae None admin] RBAC: Authorizing `identity:get_project(project_id=20fbbdffa9b84d99b150f2395751706c)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:32.934926 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f0772-d748-4389-997f-1fb6c6a7bdae None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:32.941255 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 64/125] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:32 2022] GET /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:32.941255 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f0772-d748-4389-997f-1fb6c6a7bdae None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:33.014269 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:33.053324 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233a9aa-7bda-4db5-a21a-65dbca509701 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:33.055666 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f0772-d748-4389-997f-1fb6c6a7bdae None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:33.089541 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca6f43-0ace-45df-aa0e-01073f2344a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:33.090546 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca6f43-0ace-45df-aa0e-01073f2344a9 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:33.091272 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6959e83-408a-48e1-a769-d03ccb7d34c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:33.091390 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca6f43-0ace-45df-aa0e-01073f2344a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:33.091563 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca6f43-0ace-45df-aa0e-01073f2344a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:33.092214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6959e83-408a-48e1-a769-d03ccb7d34c3 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:33.092571 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6959e83-408a-48e1-a769-d03ccb7d34c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:33.092916 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6959e83-408a-48e1-a769-d03ccb7d34c3 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:33.093838 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6959e83-408a-48e1-a769-d03ccb7d34c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:33.094212 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6959e83-408a-48e1-a769-d03ccb7d34c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:33.095810 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6959e83-408a-48e1-a769-d03ccb7d34c3 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:33.103180 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca6f43-0ace-45df-aa0e-01073f2344a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:33.106880 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 65/126] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:13:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:33.107945 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6959e83-408a-48e1-a769-d03ccb7d34c3 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:33.111930 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-b5ca6f43-0ace-45df-aa0e-01073f2344a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:13:33.111930 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:33.111930 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:33.111930 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:33.111930 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:33.111930 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:33.111930 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:33.111930 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:33.111930 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:33.111930 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:33.111930 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:33.111930 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:33.111930 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:33.111930 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:33.111930 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:33.111930 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:33.112796 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:33.112796 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:33.112796 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:33.112796 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:33.112796 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:33.112796 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:33.112796 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:33.112796 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:33.112796 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:33.112796 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:33.112796 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:33.112796 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:33.112796 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:33.112796 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:33.112796 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:33.112796 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:33.113562 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:33.113562 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:33.113562 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:33.113562 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:33.113562 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:33.113562 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:33.113562 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:33.113562 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:33.113562 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:33.113562 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:33.113562 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:13:33.113562 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:13:33.113562 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 62/127] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:13:33.114198 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca6f43-0ace-45df-aa0e-01073f2344a9 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:33.161193 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:33.214263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca6f43-0ace-45df-aa0e-01073f2344a9 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:33.219545 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6959e83-408a-48e1-a769-d03ccb7d34c3 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:33.247772 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9907f-eb07-4c52-a8f7-02704f700e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:33.248665 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9907f-eb07-4c52-a8f7-02704f700e39 None admin] REQUEST_METHOD: `PUT` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:33.248948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9907f-eb07-4c52-a8f7-02704f700e39 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:33.249223 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9907f-eb07-4c52-a8f7-02704f700e39 None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c/users/f9689251030946e8ba0417a0a5385957/roles/ae295b7c396a4e559ecd6d574f097d4a` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:33.251210 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9907f-eb07-4c52-a8f7-02704f700e39 None admin] RBAC: Authorizing `identity:create_grant(project_id=20fbbdffa9b84d99b150f2395751706c, user_id=f9689251030946e8ba0417a0a5385957, role_id=ae295b7c396a4e559ecd6d574f097d4a)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:33.251365 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:33.252699 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9907f-eb07-4c52-a8f7-02704f700e39 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:33.258612 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de0fdf-4a1f-4c1a-ba9d-e3a3ddac3859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:33.259627 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de0fdf-4a1f-4c1a-ba9d-e3a3ddac3859 None admin] REQUEST_METHOD: `PUT` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:33.259915 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de0fdf-4a1f-4c1a-ba9d-e3a3ddac3859 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:33.260187 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de0fdf-4a1f-4c1a-ba9d-e3a3ddac3859 None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c/users/3d76b2e90106415987b2b47fc32218a0/roles/ee8d50c25f9347d5b99d4a346f7c2fa8` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:33.262413 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de0fdf-4a1f-4c1a-ba9d-e3a3ddac3859 None admin] RBAC: Authorizing `identity:create_grant(project_id=20fbbdffa9b84d99b150f2395751706c, user_id=3d76b2e90106415987b2b47fc32218a0, role_id=ee8d50c25f9347d5b99d4a346f7c2fa8)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:33.264084 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de0fdf-4a1f-4c1a-ba9d-e3a3ddac3859 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:33.265243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 63/128] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 24 17:13:33 2022] PUT /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c/users/f9689251030946e8ba0417a0a5385957/roles/ae295b7c396a4e559ecd6d574f097d4a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:13:33.266074 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9907f-eb07-4c52-a8f7-02704f700e39 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:33.293860 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 66/129] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 24 17:13:33 2022] PUT /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c/users/3d76b2e90106415987b2b47fc32218a0/roles/ee8d50c25f9347d5b99d4a346f7c2fa8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:13:33.295172 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de0fdf-4a1f-4c1a-ba9d-e3a3ddac3859 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:33.415729 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9907f-eb07-4c52-a8f7-02704f700e39 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:33.427731 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de0fdf-4a1f-4c1a-ba9d-e3a3ddac3859 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:33.427928 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:33.467241 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7acd9f-597a-4226-8651-d49759b8a8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:33.468157 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7acd9f-597a-4226-8651-d49759b8a8b1 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:33.468435 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7acd9f-597a-4226-8651-d49759b8a8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:33.468708 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7acd9f-597a-4226-8651-d49759b8a8b1 None admin] PATH_INFO: `/v3/users/3d76b2e90106415987b2b47fc32218a0` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:33.469987 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7acd9f-597a-4226-8651-d49759b8a8b1 None admin] RBAC: Authorizing `identity:get_user(user_id=3d76b2e90106415987b2b47fc32218a0)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:33.471376 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f57a76-354c-4819-8c96-c03e4592ad76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:33.471607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7acd9f-597a-4226-8651-d49759b8a8b1 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:33.472455 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f57a76-354c-4819-8c96-c03e4592ad76 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:33.472923 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f57a76-354c-4819-8c96-c03e4592ad76 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:33.473384 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f57a76-354c-4819-8c96-c03e4592ad76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:33.473480 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 67/130] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:33 2022] GET /identity/v3/users/3d76b2e90106415987b2b47fc32218a0 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:33.474281 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7acd9f-597a-4226-8651-d49759b8a8b1 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:33.482718 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f57a76-354c-4819-8c96-c03e4592ad76 None admin] RBAC: Adding query filter params (role.id=b0d58ae775d64617af2ab8d0f0952ea6, scope.project.id=20fbbdffa9b84d99b150f2395751706c, user.id=a2dc6fa37c7a42b49c96f32fe3622bb4) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:33.482718 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f57a76-354c-4819-8c96-c03e4592ad76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:33.482718 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f57a76-354c-4819-8c96-c03e4592ad76 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:33.496516 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 64/131] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:13:33 2022] GET /identity/v3/role_assignments?user.id=a2dc6fa37c7a42b49c96f32fe3622bb4&scope.project.id=20fbbdffa9b84d99b150f2395751706c&role.id=b0d58ae775d64617af2ab8d0f0952ea6 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:33.498543 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f57a76-354c-4819-8c96-c03e4592ad76 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:33.608943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:33.678463 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7acd9f-597a-4226-8651-d49759b8a8b1 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:33.693868 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f57a76-354c-4819-8c96-c03e4592ad76 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:33.738184 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd8c28-7d07-4714-8a8e-ddec5614c1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:33.739136 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd8c28-7d07-4714-8a8e-ddec5614c1ee None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:33.740597 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd8c28-7d07-4714-8a8e-ddec5614c1ee None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:33.740597 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd8c28-7d07-4714-8a8e-ddec5614c1ee None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:33.741890 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd8c28-7d07-4714-8a8e-ddec5614c1ee None admin] RBAC: Authorizing `identity:get_project(project_id=20fbbdffa9b84d99b150f2395751706c)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:33.743877 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd8c28-7d07-4714-8a8e-ddec5614c1ee None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:33.747331 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 65/132] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:33 2022] GET /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:33.752107 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cce592-867f-455b-8f6c-7e125591fb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:33.752943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cce592-867f-455b-8f6c-7e125591fb32 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:33.753290 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cce592-867f-455b-8f6c-7e125591fb32 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:33.753671 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cce592-867f-455b-8f6c-7e125591fb32 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:33.754488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cce592-867f-455b-8f6c-7e125591fb32 None admin] RBAC: Adding query filter params (name=member) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:33.754881 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cce592-867f-455b-8f6c-7e125591fb32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:33.755924 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd8c28-7d07-4714-8a8e-ddec5614c1ee None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:33.756458 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cce592-867f-455b-8f6c-7e125591fb32 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:33.780064 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 68/133] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:13:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:33.785757 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cce592-867f-455b-8f6c-7e125591fb32 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:33.804278 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:33.877306 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd8c28-7d07-4714-8a8e-ddec5614c1ee None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:33.918306 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d77a6-1f5d-4963-a4a8-0931c967db8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:33.920372 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d77a6-1f5d-4963-a4a8-0931c967db8f None admin] REQUEST_METHOD: `PUT` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:33.920865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d77a6-1f5d-4963-a4a8-0931c967db8f None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:33.921322 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d77a6-1f5d-4963-a4a8-0931c967db8f None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c/users/3d76b2e90106415987b2b47fc32218a0/roles/bbc0c8e77a594880a35aae1d21773668` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:33.930414 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d77a6-1f5d-4963-a4a8-0931c967db8f None admin] RBAC: Authorizing `identity:create_grant(project_id=20fbbdffa9b84d99b150f2395751706c, user_id=3d76b2e90106415987b2b47fc32218a0, role_id=bbc0c8e77a594880a35aae1d21773668)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:33.931936 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d77a6-1f5d-4963-a4a8-0931c967db8f None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:33.962313 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 66/134] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 24 17:13:33 2022] PUT /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c/users/3d76b2e90106415987b2b47fc32218a0/roles/bbc0c8e77a594880a35aae1d21773668 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:13:33.998481 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cce592-867f-455b-8f6c-7e125591fb32 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:34.035012 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:34.054550 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755520b-1805-4bee-b6cf-3073a0be95af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:34.055486 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755520b-1805-4bee-b6cf-3073a0be95af None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:34.058268 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755520b-1805-4bee-b6cf-3073a0be95af None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:34.058551 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755520b-1805-4bee-b6cf-3073a0be95af None admin] PATH_INFO: `/v3/users/3d76b2e90106415987b2b47fc32218a0` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:34.060003 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755520b-1805-4bee-b6cf-3073a0be95af None admin] RBAC: Authorizing `identity:get_user(user_id=3d76b2e90106415987b2b47fc32218a0)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:34.061496 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755520b-1805-4bee-b6cf-3073a0be95af None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:34.063459 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 69/135] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:33 2022] GET /identity/v3/users/3d76b2e90106415987b2b47fc32218a0 => generated 275 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:13:34.069029 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d77a6-1f5d-4963-a4a8-0931c967db8f None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:34.200582 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:34.204880 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d77a6-1f5d-4963-a4a8-0931c967db8f None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:34.250596 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f134bf9-d06e-498f-a709-d4f9a5bc16a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:34.251658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f134bf9-d06e-498f-a709-d4f9a5bc16a1 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:34.251850 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f134bf9-d06e-498f-a709-d4f9a5bc16a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:34.252095 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f134bf9-d06e-498f-a709-d4f9a5bc16a1 None admin] PATH_INFO: `/v3/projects/06d50bf5f7074d4ab6784ffaf232bbfc` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:34.253328 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f134bf9-d06e-498f-a709-d4f9a5bc16a1 None admin] RBAC: Authorizing `identity:get_project(project_id=06d50bf5f7074d4ab6784ffaf232bbfc)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:34.254837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f134bf9-d06e-498f-a709-d4f9a5bc16a1 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:34.256559 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 67/136] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:34 2022] GET /identity/v3/projects/06d50bf5f7074d4ab6784ffaf232bbfc => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:34.263447 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755520b-1805-4bee-b6cf-3073a0be95af None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:34.406772 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755520b-1805-4bee-b6cf-3073a0be95af None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:34.443698 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb38c0-5697-43b2-b7f9-749eddf0a48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:34.444962 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb38c0-5697-43b2-b7f9-749eddf0a48c None admin] REQUEST_METHOD: `PUT` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:34.445461 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb38c0-5697-43b2-b7f9-749eddf0a48c None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:34.445945 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb38c0-5697-43b2-b7f9-749eddf0a48c None admin] PATH_INFO: `/v3/projects/06d50bf5f7074d4ab6784ffaf232bbfc/users/3d76b2e90106415987b2b47fc32218a0/roles/ee8d50c25f9347d5b99d4a346f7c2fa8` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:34.448193 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb38c0-5697-43b2-b7f9-749eddf0a48c None admin] RBAC: Authorizing `identity:create_grant(project_id=06d50bf5f7074d4ab6784ffaf232bbfc, user_id=3d76b2e90106415987b2b47fc32218a0, role_id=ee8d50c25f9347d5b99d4a346f7c2fa8)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:34.450007 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb38c0-5697-43b2-b7f9-749eddf0a48c None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:34.465578 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 70/137] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 24 17:13:34 2022] PUT /identity/v3/projects/06d50bf5f7074d4ab6784ffaf232bbfc/users/3d76b2e90106415987b2b47fc32218a0/roles/ee8d50c25f9347d5b99d4a346f7c2fa8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:13:34.523616 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed20938-b0d4-42bf-a599-46c6f82acbb5 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:34.523981 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed20938-b0d4-42bf-a599-46c6f82acbb5 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:34.524188 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed20938-b0d4-42bf-a599-46c6f82acbb5 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:34.525599 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 68/138] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:34.531350 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed51cfa-e2e1-48a3-841d-3ba887e8ab4d None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:34.531925 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed51cfa-e2e1-48a3-841d-3ba887e8ab4d None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:34.532457 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed51cfa-e2e1-48a3-841d-3ba887e8ab4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:34.554543 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-6ed51cfa-e2e1-48a3-841d-3ba887e8ab4d None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:34.556194 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-6ed51cfa-e2e1-48a3-841d-3ba887e8ab4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:34.608057 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:34.649225 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 71/139] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:34.691530 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed20938-b0d4-42bf-a599-46c6f82acbb5 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:34.841476 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed20938-b0d4-42bf-a599-46c6f82acbb5 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:34.900179 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c4e2e-7475-4206-9ded-104610aa5832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:34.901342 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c4e2e-7475-4206-9ded-104610aa5832 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:34.901836 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c4e2e-7475-4206-9ded-104610aa5832 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:34.902318 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c4e2e-7475-4206-9ded-104610aa5832 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:34.903970 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c4e2e-7475-4206-9ded-104610aa5832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:34.905669 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c4e2e-7475-4206-9ded-104610aa5832 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:34.908991 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 69/140] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:13:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:34.913912 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed51cfa-e2e1-48a3-841d-3ba887e8ab4d None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:35.043260 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed51cfa-e2e1-48a3-841d-3ba887e8ab4d None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:35.078760 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab9626-34ea-4e6d-9787-176a7ad9e58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:35.079440 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab9626-34ea-4e6d-9787-176a7ad9e58e None admin] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:35.079721 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab9626-34ea-4e6d-9787-176a7ad9e58e None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:35.079997 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab9626-34ea-4e6d-9787-176a7ad9e58e None admin] PATH_INFO: `/v3/users` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:35.080708 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab9626-34ea-4e6d-9787-176a7ad9e58e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:35.082176 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab9626-34ea-4e6d-9787-176a7ad9e58e None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:35.112528 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 72/141] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 24 17:13:34 2022] POST /identity/v3/users => generated 283 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:13:36.529499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc08f13-9a35-417e-ad7d-a705558c3344 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:36.530541 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc08f13-9a35-417e-ad7d-a705558c3344 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:36.531047 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc08f13-9a35-417e-ad7d-a705558c3344 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:36.532624 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 70/142] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:36.538229 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd13c64-1b9f-439d-8c3d-7ad5d742d8ce None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:36.539098 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd13c64-1b9f-439d-8c3d-7ad5d742d8ce None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:36.539562 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd13c64-1b9f-439d-8c3d-7ad5d742d8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:36.563663 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-1dd13c64-1b9f-439d-8c3d-7ad5d742d8ce None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:36.565180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-1dd13c64-1b9f-439d-8c3d-7ad5d742d8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:36.568277 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ac0e2-af2b-4533-91fa-4522b96b4cff None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:36.568772 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ac0e2-af2b-4533-91fa-4522b96b4cff None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:36.569241 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ac0e2-af2b-4533-91fa-4522b96b4cff None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:36.571137 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 71/143] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:36.575971 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b96bc-b44f-492b-aff4-57c9c7b2b5b8 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:36.576524 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b96bc-b44f-492b-aff4-57c9c7b2b5b8 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:36.576988 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b96bc-b44f-492b-aff4-57c9c7b2b5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:36.607723 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-200b96bc-b44f-492b-aff4-57c9c7b2b5b8 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:36.609978 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-200b96bc-b44f-492b-aff4-57c9c7b2b5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:36.644655 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:36.683056 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:36.725218 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 73/144] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:36.774592 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd13c64-1b9f-439d-8c3d-7ad5d742d8ce None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:36.780379 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 72/145] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:36.813113 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b96bc-b44f-492b-aff4-57c9c7b2b5b8 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:36.948504 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd13c64-1b9f-439d-8c3d-7ad5d742d8ce None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:37.039635 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a624fc-24a6-4c05-9619-5841fe7a8a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:37.040368 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a624fc-24a6-4c05-9619-5841fe7a8a79 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:37.040653 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a624fc-24a6-4c05-9619-5841fe7a8a79 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:37.040925 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a624fc-24a6-4c05-9619-5841fe7a8a79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:37.073043 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b96bc-b44f-492b-aff4-57c9c7b2b5b8 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:37.076457 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a624fc-24a6-4c05-9619-5841fe7a8a79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:37.084366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-b7a624fc-24a6-4c05-9619-5841fe7a8a79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:13:37.084366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:37.084366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:37.084366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:37.084366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:37.084366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:37.084366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:37.084366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:37.084366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:37.084366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:37.084366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:37.084366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:37.084366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:37.084366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:37.084366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:37.084366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:37.085205 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:37.085205 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:37.085205 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:37.085205 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:37.085205 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:37.085205 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:37.085205 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:37.085205 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:37.085205 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:37.085205 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:37.085205 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:37.085205 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:37.085205 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:37.085205 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:37.085205 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:37.085205 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:37.085978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:37.085978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:37.085978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:37.085978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:37.085978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:37.085978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:37.085978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:37.085978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:37.085978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:37.085978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:37.085978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:13:37.085978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:13:37.090729 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 74/146] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 24 17:13:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:13:37.091741 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a624fc-24a6-4c05-9619-5841fe7a8a79 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:37.131321 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6e6a7-ec68-4d90-94d3-6e3b914d7f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:37.132141 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6e6a7-ec68-4d90-94d3-6e3b914d7f89 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:37.132431 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6e6a7-ec68-4d90-94d3-6e3b914d7f89 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:37.132696 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6e6a7-ec68-4d90-94d3-6e3b914d7f89 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:37.147665 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6e6a7-ec68-4d90-94d3-6e3b914d7f89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:37.151585 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:37.159499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-01f6e6a7-ec68-4d90-94d3-6e3b914d7f89 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 17:13:37.159499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:37.159499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:37.159499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:37.159499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:37.159499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:37.159499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:37.159499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:37.159499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:37.159499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:37.159499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:37.159499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:37.159499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:37.159499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:37.159499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:37.159499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:37.160350 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:37.160350 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:37.160350 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:37.160350 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:37.160350 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:37.160350 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:37.160350 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:37.160350 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:37.160350 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:37.160350 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:37.160350 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:37.160350 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:37.160350 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:37.160350 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:37.160350 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:37.160350 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:37.161091 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:37.161091 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:37.161091 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:37.161091 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:37.161091 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:37.161091 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:37.161091 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:37.161091 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:37.161091 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:37.161091 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:37.161091 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 17:13:37.161091 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:13:37.161665 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 73/147] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:13:37.167465 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6e6a7-ec68-4d90-94d3-6e3b914d7f89 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:37.205376 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:37.296320 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a624fc-24a6-4c05-9619-5841fe7a8a79 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:37.321406 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6e6a7-ec68-4d90-94d3-6e3b914d7f89 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:37.363544 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb852dfb-508a-48d4-b88f-521a4c62159b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:37.364255 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb852dfb-508a-48d4-b88f-521a4c62159b None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:37.364542 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb852dfb-508a-48d4-b88f-521a4c62159b None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:37.364818 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb852dfb-508a-48d4-b88f-521a4c62159b None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:37.365581 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb852dfb-508a-48d4-b88f-521a4c62159b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:37.365897 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb852dfb-508a-48d4-b88f-521a4c62159b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:37.368722 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb852dfb-508a-48d4-b88f-521a4c62159b None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:37.378623 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb878258-f163-4e25-8c70-d57b661ff10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:37.379632 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb878258-f163-4e25-8c70-d57b661ff10f None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:37.380108 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb878258-f163-4e25-8c70-d57b661ff10f None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:37.380578 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb878258-f163-4e25-8c70-d57b661ff10f None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:37.380763 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 75/148] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:37.381687 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb878258-f163-4e25-8c70-d57b661ff10f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:37.382090 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1510e-65ea-4e4b-b962-776412365ef5 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:37.382377 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1510e-65ea-4e4b-b962-776412365ef5 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:37.382472 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb878258-f163-4e25-8c70-d57b661ff10f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:37.382651 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1510e-65ea-4e4b-b962-776412365ef5 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:37.383875 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 76/149] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:37.384458 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb878258-f163-4e25-8c70-d57b661ff10f None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:37.389535 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b50584-6b67-4a59-9af6-16b2d27a5c5a None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:37.389816 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b50584-6b67-4a59-9af6-16b2d27a5c5a None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:37.390092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b50584-6b67-4a59-9af6-16b2d27a5c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:37.401747 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 74/150] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:13:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:37.402953 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb878258-f163-4e25-8c70-d57b661ff10f None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:37.416568 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-74b50584-6b67-4a59-9af6-16b2d27a5c5a None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:37.419886 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-74b50584-6b67-4a59-9af6-16b2d27a5c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:37.555177 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:37.558000 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 77/151] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 17:13:37.559134 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b50584-6b67-4a59-9af6-16b2d27a5c5a None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:37.585454 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb878258-f163-4e25-8c70-d57b661ff10f None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:37.589819 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:37.632295 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44ecaa-e131-4824-8dd8-a63d33cf6c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:37.633553 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44ecaa-e131-4824-8dd8-a63d33cf6c68 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:37.634017 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44ecaa-e131-4824-8dd8-a63d33cf6c68 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:37.634486 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44ecaa-e131-4824-8dd8-a63d33cf6c68 None admin] PATH_INFO: `/v3/users/f9689251030946e8ba0417a0a5385957` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:37.636498 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44ecaa-e131-4824-8dd8-a63d33cf6c68 None admin] RBAC: Authorizing `identity:get_user(user_id=f9689251030946e8ba0417a0a5385957)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:37.639896 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44ecaa-e131-4824-8dd8-a63d33cf6c68 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:37.642003 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 75/152] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:37 2022] GET /identity/v3/users/f9689251030946e8ba0417a0a5385957 => generated 247 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:37.644815 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7baf2-ebc9-4f91-8ae8-87fb79660237 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:37.645980 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7baf2-ebc9-4f91-8ae8-87fb79660237 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:37.646620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7baf2-ebc9-4f91-8ae8-87fb79660237 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:37.650620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 76/153] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:37.652417 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7baf2-ebc9-4f91-8ae8-87fb79660237 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:37.780637 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b50584-6b67-4a59-9af6-16b2d27a5c5a None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:37.838722 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99eb93-9eaf-49b4-8b57-228c48b63ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:37.840024 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99eb93-9eaf-49b4-8b57-228c48b63ffd None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:37.840446 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99eb93-9eaf-49b4-8b57-228c48b63ffd None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:37.840806 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99eb93-9eaf-49b4-8b57-228c48b63ffd None admin] PATH_INFO: `/v3/users/a2dc6fa37c7a42b49c96f32fe3622bb4` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:37.842128 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99eb93-9eaf-49b4-8b57-228c48b63ffd None admin] RBAC: Authorizing `identity:get_user(user_id=a2dc6fa37c7a42b49c96f32fe3622bb4)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:37.843780 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99eb93-9eaf-49b4-8b57-228c48b63ffd None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:37.845856 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 78/154] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:37 2022] GET /identity/v3/users/a2dc6fa37c7a42b49c96f32fe3622bb4 => generated 289 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:37.848138 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7baf2-ebc9-4f91-8ae8-87fb79660237 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:37.850898 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99eb93-9eaf-49b4-8b57-228c48b63ffd None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:37.919297 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf41bcd-b1b0-4925-a09d-205cf0d249bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:37.920120 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf41bcd-b1b0-4925-a09d-205cf0d249bd None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:37.920400 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf41bcd-b1b0-4925-a09d-205cf0d249bd None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:37.920676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf41bcd-b1b0-4925-a09d-205cf0d249bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:37.936116 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf41bcd-b1b0-4925-a09d-205cf0d249bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:37.946904 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:37.960503 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-0cf41bcd-b1b0-4925-a09d-205cf0d249bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:13:37.960503 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:37.960503 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:37.960503 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:37.960503 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:37.960503 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:37.960503 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:37.960503 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:37.960503 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:37.960503 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:37.960503 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:37.960503 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:37.960503 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:37.960503 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:37.960503 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:37.960503 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:37.961387 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:37.961387 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:37.961387 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:37.961387 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:37.961387 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:37.961387 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:37.961387 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:37.961387 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:37.961387 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:37.961387 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:37.961387 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:37.961387 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:37.961387 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:37.961387 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:37.961387 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:37.961387 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:37.962299 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:37.962299 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:37.962299 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:37.962299 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:37.962299 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:37.962299 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:37.962299 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:37.962299 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:37.962299 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:37.962299 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:37.962299 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:13:37.962299 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:13:37.962299 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 77/155] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 24 17:13:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:13:37.963504 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e804212-532d-4dd5-bdbc-41a60407f4ed None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:37.963504 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e804212-532d-4dd5-bdbc-41a60407f4ed None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:37.970309 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99eb93-9eaf-49b4-8b57-228c48b63ffd None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:37.970737 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e804212-532d-4dd5-bdbc-41a60407f4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:38.001591 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-5e804212-532d-4dd5-bdbc-41a60407f4ed None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:38.002935 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-5e804212-532d-4dd5-bdbc-41a60407f4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:38.006137 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c36907-c8d8-4f1f-87b4-4cdfdd087238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:38.006856 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c36907-c8d8-4f1f-87b4-4cdfdd087238 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:38.007132 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c36907-c8d8-4f1f-87b4-4cdfdd087238 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:38.007400 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c36907-c8d8-4f1f-87b4-4cdfdd087238 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:38.014915 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:38.088859 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c36907-c8d8-4f1f-87b4-4cdfdd087238 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:38.090352 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c36907-c8d8-4f1f-87b4-4cdfdd087238 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:38.117691 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 78/156] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:38.117691 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e804212-532d-4dd5-bdbc-41a60407f4ed None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:38.274970 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:38.302181 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 79/157] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:13:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:13:38.303093 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c36907-c8d8-4f1f-87b4-4cdfdd087238 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:38.372290 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e804212-532d-4dd5-bdbc-41a60407f4ed None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:38.460060 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713b7a7-1f6f-4ade-a9c8-e0c3acb1082b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:38.460941 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713b7a7-1f6f-4ade-a9c8-e0c3acb1082b None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:38.461216 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713b7a7-1f6f-4ade-a9c8-e0c3acb1082b None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:38.461486 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713b7a7-1f6f-4ade-a9c8-e0c3acb1082b None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:38.462759 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713b7a7-1f6f-4ade-a9c8-e0c3acb1082b None admin] RBAC: Authorizing `identity:get_project(project_id=20fbbdffa9b84d99b150f2395751706c)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:38.464233 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713b7a7-1f6f-4ade-a9c8-e0c3acb1082b None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:38.465985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 79/158] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:38 2022] GET /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c => generated 298 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:38.473282 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713b7a7-1f6f-4ade-a9c8-e0c3acb1082b None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:38.509165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:38.528733 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c36907-c8d8-4f1f-87b4-4cdfdd087238 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:38.588974 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721efad-e878-48cc-972e-be903d6576be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:38.590656 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721efad-e878-48cc-972e-be903d6576be None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:38.591139 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721efad-e878-48cc-972e-be903d6576be None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:38.591599 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721efad-e878-48cc-972e-be903d6576be None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:38.592558 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721efad-e878-48cc-972e-be903d6576be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:38.593048 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721efad-e878-48cc-972e-be903d6576be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:38.594644 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721efad-e878-48cc-972e-be903d6576be None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:38.616791 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 80/159] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:13:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:38.617932 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721efad-e878-48cc-972e-be903d6576be None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:38.710939 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:38.712774 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713b7a7-1f6f-4ade-a9c8-e0c3acb1082b None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:38.769097 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721efad-e878-48cc-972e-be903d6576be None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:38.792292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8456815-4077-4ae8-8502-2746bf54f1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:38.793163 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8456815-4077-4ae8-8502-2746bf54f1e4 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:38.793437 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8456815-4077-4ae8-8502-2746bf54f1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:38.793704 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8456815-4077-4ae8-8502-2746bf54f1e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:38.815325 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8456815-4077-4ae8-8502-2746bf54f1e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:38.822939 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-c8456815-4077-4ae8-8502-2746bf54f1e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:13:38.822939 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:38.822939 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:38.822939 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:38.822939 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:38.822939 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:38.822939 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:38.822939 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:38.822939 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:38.822939 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:38.822939 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:38.822939 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:38.822939 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:38.822939 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:38.822939 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:38.822939 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:38.823864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:38.823864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:38.823864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:38.823864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:38.823864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:38.823864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:38.823864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:38.823864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:38.823864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:38.823864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:38.823864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:38.823864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:38.823864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:38.823864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:38.823864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:38.823864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:38.824688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:38.824688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:38.824688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:38.824688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:38.824688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:38.824688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:38.824688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:38.824688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:38.824688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:38.824688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:38.824688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:13:38.824688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:13:38.824688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 80/160] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:13:38.831179 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8456815-4077-4ae8-8502-2746bf54f1e4 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:38.837674 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05637bc9-c9ff-4454-8b03-94068274f5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:38.842601 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05637bc9-c9ff-4454-8b03-94068274f5d4 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:38.842601 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05637bc9-c9ff-4454-8b03-94068274f5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:38.842601 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05637bc9-c9ff-4454-8b03-94068274f5d4 None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:38.842601 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05637bc9-c9ff-4454-8b03-94068274f5d4 None admin] RBAC: Authorizing `identity:get_project(project_id=20fbbdffa9b84d99b150f2395751706c)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:38.842601 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05637bc9-c9ff-4454-8b03-94068274f5d4 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:38.844323 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 81/161] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:38 2022] GET /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:38.846229 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb5cde-19c7-4dd0-abd7-afdb522d0d4a None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:38.846516 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb5cde-19c7-4dd0-abd7-afdb522d0d4a None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:38.846812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb5cde-19c7-4dd0-abd7-afdb522d0d4a None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:38.848011 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 82/162] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:38.848687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb5cde-19c7-4dd0-abd7-afdb522d0d4a None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:38.965402 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:39.001826 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8456815-4077-4ae8-8502-2746bf54f1e4 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:39.046624 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb5cde-19c7-4dd0-abd7-afdb522d0d4a None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:39.051192 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b3982-e08d-4c75-8a88-5fe98fdad315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:39.052089 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b3982-e08d-4c75-8a88-5fe98fdad315 None admin] REQUEST_METHOD: `PUT` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:39.052363 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b3982-e08d-4c75-8a88-5fe98fdad315 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:39.052634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b3982-e08d-4c75-8a88-5fe98fdad315 None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c/users/a2dc6fa37c7a42b49c96f32fe3622bb4/roles/b0d58ae775d64617af2ab8d0f0952ea6` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:39.054610 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b3982-e08d-4c75-8a88-5fe98fdad315 None admin] RBAC: Authorizing `identity:create_grant(project_id=20fbbdffa9b84d99b150f2395751706c, user_id=a2dc6fa37c7a42b49c96f32fe3622bb4, role_id=b0d58ae775d64617af2ab8d0f0952ea6)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:39.057131 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b3982-e08d-4c75-8a88-5fe98fdad315 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:39.074180 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 81/163] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 24 17:13:38 2022] PUT /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c/users/a2dc6fa37c7a42b49c96f32fe3622bb4/roles/b0d58ae775d64617af2ab8d0f0952ea6 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:13:39.074926 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b3982-e08d-4c75-8a88-5fe98fdad315 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:39.082336 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:39.140836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b8e0e-de0c-4acd-beae-2f8fa7e8cefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:39.141741 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b8e0e-de0c-4acd-beae-2f8fa7e8cefc None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:39.142019 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b8e0e-de0c-4acd-beae-2f8fa7e8cefc None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:39.142273 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b8e0e-de0c-4acd-beae-2f8fa7e8cefc None admin] PATH_INFO: `/v3/users/3d76b2e90106415987b2b47fc32218a0` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:39.147415 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b8e0e-de0c-4acd-beae-2f8fa7e8cefc None admin] RBAC: Authorizing `identity:get_user(user_id=3d76b2e90106415987b2b47fc32218a0)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:39.149224 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b8e0e-de0c-4acd-beae-2f8fa7e8cefc None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:39.151354 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 83/164] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:38 2022] GET /identity/v3/users/3d76b2e90106415987b2b47fc32218a0 => generated 275 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:39.152489 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b8e0e-de0c-4acd-beae-2f8fa7e8cefc None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:39.206256 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b3982-e08d-4c75-8a88-5fe98fdad315 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:39.243350 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:39.250739 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b82915-ba18-494e-bb6e-f2ddceb9d55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:39.251831 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b82915-ba18-494e-bb6e-f2ddceb9d55d None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:39.252882 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b82915-ba18-494e-bb6e-f2ddceb9d55d None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:39.253305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b82915-ba18-494e-bb6e-f2ddceb9d55d None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:39.254196 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b82915-ba18-494e-bb6e-f2ddceb9d55d None admin] RBAC: Adding query filter params (name=member) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:39.254862 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b82915-ba18-494e-bb6e-f2ddceb9d55d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:39.256617 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b82915-ba18-494e-bb6e-f2ddceb9d55d None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:39.268825 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 82/165] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:13:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:39.270387 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8986d-7006-4301-bd3b-8d447172a2ec None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:39.270825 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8986d-7006-4301-bd3b-8d447172a2ec None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:39.271257 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8986d-7006-4301-bd3b-8d447172a2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:39.291373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-1fc8986d-7006-4301-bd3b-8d447172a2ec None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:39.293898 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-1fc8986d-7006-4301-bd3b-8d447172a2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:39.364271 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b8e0e-de0c-4acd-beae-2f8fa7e8cefc None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:39.376383 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 83/166] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:39.377495 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8986d-7006-4301-bd3b-8d447172a2ec None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:39.474093 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa674efc-28a3-4b53-97cb-141cc3abe9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:39.474736 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa674efc-28a3-4b53-97cb-141cc3abe9c0 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:39.475016 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa674efc-28a3-4b53-97cb-141cc3abe9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:39.475286 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa674efc-28a3-4b53-97cb-141cc3abe9c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:39.476142 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa674efc-28a3-4b53-97cb-141cc3abe9c0 None admin] RBAC: Adding query filter params (role.id=ae295b7c396a4e559ecd6d574f097d4a, scope.project.id=20fbbdffa9b84d99b150f2395751706c, user.id=f9689251030946e8ba0417a0a5385957) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:39.476441 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa674efc-28a3-4b53-97cb-141cc3abe9c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:39.477938 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa674efc-28a3-4b53-97cb-141cc3abe9c0 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:39.491552 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 84/167] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:13:39 2022] GET /identity/v3/role_assignments?user.id=f9689251030946e8ba0417a0a5385957&scope.project.id=20fbbdffa9b84d99b150f2395751706c&role.id=ae295b7c396a4e559ecd6d574f097d4a => generated 608 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:39.492492 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa674efc-28a3-4b53-97cb-141cc3abe9c0 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:39.556780 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8986d-7006-4301-bd3b-8d447172a2ec None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:39.584524 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:39.618957 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:39.643975 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d697f-62fa-4a64-a80e-c8f6006fa5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:39.644641 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d697f-62fa-4a64-a80e-c8f6006fa5c1 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:39.644927 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d697f-62fa-4a64-a80e-c8f6006fa5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:39.645197 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d697f-62fa-4a64-a80e-c8f6006fa5c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:39.660117 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa674efc-28a3-4b53-97cb-141cc3abe9c0 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:39.708948 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0198f7-7601-43f9-b12c-3f2f3c19c7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:39.709850 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0198f7-7601-43f9-b12c-3f2f3c19c7ee None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:39.710129 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0198f7-7601-43f9-b12c-3f2f3c19c7ee None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:39.710400 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0198f7-7601-43f9-b12c-3f2f3c19c7ee None admin] PATH_INFO: `/v3/users/3d76b2e90106415987b2b47fc32218a0` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:39.715481 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0198f7-7601-43f9-b12c-3f2f3c19c7ee None admin] RBAC: Authorizing `identity:get_user(user_id=3d76b2e90106415987b2b47fc32218a0)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:39.717027 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0198f7-7601-43f9-b12c-3f2f3c19c7ee None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:39.719216 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 85/168] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:39 2022] GET /identity/v3/users/3d76b2e90106415987b2b47fc32218a0 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:39.720045 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0198f7-7601-43f9-b12c-3f2f3c19c7ee None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:39.747601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d697f-62fa-4a64-a80e-c8f6006fa5c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:39.749121 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d697f-62fa-4a64-a80e-c8f6006fa5c1 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:39.933685 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0198f7-7601-43f9-b12c-3f2f3c19c7ee None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:39.936471 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 84/169] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:13:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:13:39.938279 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d697f-62fa-4a64-a80e-c8f6006fa5c1 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:39.951032 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:39.978663 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:39.981167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b2746-5e07-4271-a575-85b917a6c203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:39.982155 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b2746-5e07-4271-a575-85b917a6c203 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:39.982558 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b2746-5e07-4271-a575-85b917a6c203 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:39.983001 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b2746-5e07-4271-a575-85b917a6c203 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:39.995437 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b2746-5e07-4271-a575-85b917a6c203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:40.005167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-2a3b2746-5e07-4271-a575-85b917a6c203 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:13:40.005167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:40.005167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:40.005167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:40.005167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:40.005167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:40.005167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:40.005167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:40.005167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:40.005167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:40.005167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:40.005167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:40.005167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:40.005167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:40.005167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:40.005167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:40.006195 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:40.006195 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:40.006195 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:40.006195 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:40.006195 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:40.006195 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:40.006195 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:40.006195 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:40.006195 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:40.006195 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:40.006195 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:40.006195 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:40.006195 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:40.006195 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:40.006195 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:40.006195 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:40.006994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:40.006994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:40.006994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:40.006994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:40.006994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:40.006994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:40.006994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:40.006994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:40.006994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:40.006994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:40.006994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:13:40.006994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:13:40.006994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 86/170] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:13:40.008258 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c41df-5dfa-44a6-9d24-3518e061450d None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:40.008258 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c41df-5dfa-44a6-9d24-3518e061450d None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:40.008560 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c41df-5dfa-44a6-9d24-3518e061450d None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:40.009939 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 87/171] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:40.035762 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09da9b-1ec2-43f8-b59f-d9049756d1c5 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:40.036206 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09da9b-1ec2-43f8-b59f-d9049756d1c5 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:40.036621 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09da9b-1ec2-43f8-b59f-d9049756d1c5 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:40.038216 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 88/172] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:40 2022] GET /identity => generated 270 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:40.039086 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09da9b-1ec2-43f8-b59f-d9049756d1c5 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:40.082261 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d697f-62fa-4a64-a80e-c8f6006fa5c1 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:40.133637 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b740e-14bb-46c8-a40f-b3a8fd37041f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:40.134358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b740e-14bb-46c8-a40f-b3a8fd37041f None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:40.134670 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b740e-14bb-46c8-a40f-b3a8fd37041f None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:40.134993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b740e-14bb-46c8-a40f-b3a8fd37041f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:40.173037 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09da9b-1ec2-43f8-b59f-d9049756d1c5 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:40.226822 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b740e-14bb-46c8-a40f-b3a8fd37041f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:40.227952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c98df3-4302-4bc9-bdec-1fe324ff01d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:40.228338 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b740e-14bb-46c8-a40f-b3a8fd37041f None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:40.229617 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c98df3-4302-4bc9-bdec-1fe324ff01d9 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:40.230156 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c98df3-4302-4bc9-bdec-1fe324ff01d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:40.231453 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c98df3-4302-4bc9-bdec-1fe324ff01d9 None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:40.233175 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c98df3-4302-4bc9-bdec-1fe324ff01d9 None admin] RBAC: Authorizing `identity:get_project(project_id=20fbbdffa9b84d99b150f2395751706c)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:40.235015 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c98df3-4302-4bc9-bdec-1fe324ff01d9 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:40.237070 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 89/173] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:40 2022] GET /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:40.238703 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c0c7b-98a6-454a-bfe7-a4257fb9d7d1 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:40.239222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c0c7b-98a6-454a-bfe7-a4257fb9d7d1 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:40.239688 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c0c7b-98a6-454a-bfe7-a4257fb9d7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:40.258906 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-240c0c7b-98a6-454a-bfe7-a4257fb9d7d1 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:40.260487 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-240c0c7b-98a6-454a-bfe7-a4257fb9d7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:40.266918 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:40.304899 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:40.343182 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 90/174] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:40.351907 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c0c7b-98a6-454a-bfe7-a4257fb9d7d1 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:40.362399 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 85/175] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:13:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:13:40.370242 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1983071-8dd5-47ad-8a3c-8ae5e1a9df9f None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:40.372270 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1983071-8dd5-47ad-8a3c-8ae5e1a9df9f None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:40.372795 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1983071-8dd5-47ad-8a3c-8ae5e1a9df9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:40.402020 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-b1983071-8dd5-47ad-8a3c-8ae5e1a9df9f None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:40.404254 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-b1983071-8dd5-47ad-8a3c-8ae5e1a9df9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:40.476808 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 86/176] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:40.483701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1983071-8dd5-47ad-8a3c-8ae5e1a9df9f None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:40.492533 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c0c7b-98a6-454a-bfe7-a4257fb9d7d1 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:40.529910 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a4111-85f8-42b9-9832-549b6e572b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:40.530638 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a4111-85f8-42b9-9832-549b6e572b3b None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:40.530986 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a4111-85f8-42b9-9832-549b6e572b3b None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:40.531261 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a4111-85f8-42b9-9832-549b6e572b3b None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:40.532019 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a4111-85f8-42b9-9832-549b6e572b3b None admin] RBAC: Adding query filter params (name=member) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:40.532333 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a4111-85f8-42b9-9832-549b6e572b3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:40.533807 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a4111-85f8-42b9-9832-549b6e572b3b None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:40.542307 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 91/177] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:13:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:40.543254 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a4111-85f8-42b9-9832-549b6e572b3b None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:40.550869 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:40.582558 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:40.599951 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1983071-8dd5-47ad-8a3c-8ae5e1a9df9f None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:40.635490 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120491a6-d286-408e-bca3-8366c66ef433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:40.636137 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120491a6-d286-408e-bca3-8366c66ef433 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:40.636725 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120491a6-d286-408e-bca3-8366c66ef433 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:40.637036 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120491a6-d286-408e-bca3-8366c66ef433 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:40.637928 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120491a6-d286-408e-bca3-8366c66ef433 None admin] RBAC: Adding query filter params (role.id=bbc0c8e77a594880a35aae1d21773668, scope.project.id=20fbbdffa9b84d99b150f2395751706c, user.id=3d76b2e90106415987b2b47fc32218a0) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:40.638239 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120491a6-d286-408e-bca3-8366c66ef433 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:40.639743 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120491a6-d286-408e-bca3-8366c66ef433 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:40.646249 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 87/178] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:13:40 2022] GET /identity/v3/role_assignments?user.id=3d76b2e90106415987b2b47fc32218a0&scope.project.id=20fbbdffa9b84d99b150f2395751706c&role.id=bbc0c8e77a594880a35aae1d21773668 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:40.646978 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120491a6-d286-408e-bca3-8366c66ef433 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:40.662947 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a4111-85f8-42b9-9832-549b6e572b3b None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:40.712877 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47cda9-907d-4530-907b-0d45f53054bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:40.714936 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47cda9-907d-4530-907b-0d45f53054bb None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:40.715235 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47cda9-907d-4530-907b-0d45f53054bb None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:40.715880 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47cda9-907d-4530-907b-0d45f53054bb None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:40.718705 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47cda9-907d-4530-907b-0d45f53054bb None admin] RBAC: Authorizing `identity:get_project(project_id=20fbbdffa9b84d99b150f2395751706c)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:40.720375 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47cda9-907d-4530-907b-0d45f53054bb None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:40.722635 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 92/179] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:40 2022] GET /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:40.724100 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a63c5d-88fe-441f-85be-6cec006c9cf1 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:40.724737 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a63c5d-88fe-441f-85be-6cec006c9cf1 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:40.724737 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a63c5d-88fe-441f-85be-6cec006c9cf1 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:40.730163 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 93/180] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:40.730163 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a63c5d-88fe-441f-85be-6cec006c9cf1 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:40.783525 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120491a6-d286-408e-bca3-8366c66ef433 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:40.809371 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:40.835630 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f526c-e4f1-4666-a25f-9cf3f7499e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:40.836893 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f526c-e4f1-4666-a25f-9cf3f7499e42 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:40.837171 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f526c-e4f1-4666-a25f-9cf3f7499e42 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:40.837443 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f526c-e4f1-4666-a25f-9cf3f7499e42 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:40.851841 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f526c-e4f1-4666-a25f-9cf3f7499e42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:40.863101 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-2e0f526c-e4f1-4666-a25f-9cf3f7499e42 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:13:40.863101 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:40.863101 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:40.863101 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:40.863101 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:40.863101 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:40.863101 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:40.863101 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:40.863101 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:40.863101 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:40.863101 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:40.863101 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:40.863101 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:40.863101 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:40.863101 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:40.863101 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:40.864040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:40.864040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:40.864040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:40.864040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:40.864040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:40.864040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:40.864040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:40.864040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:40.864040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:40.864040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:40.864040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:40.864040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:40.864040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:40.864040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:40.864040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:40.864040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:40.864811 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:40.864811 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:40.864811 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:40.864811 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:40.864811 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:40.864811 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:40.864811 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:40.864811 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:40.864811 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:40.864811 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:40.864811 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:13:40.864811 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:13:40.864811 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 88/181] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 24 17:13:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:13:40.868986 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f526c-e4f1-4666-a25f-9cf3f7499e42 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:40.886556 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a63c5d-88fe-441f-85be-6cec006c9cf1 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:40.889998 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:40.942251 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022d21c-bb62-412a-845a-1acade7f7740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:40.943210 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022d21c-bb62-412a-845a-1acade7f7740 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:40.943556 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022d21c-bb62-412a-845a-1acade7f7740 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:40.943840 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022d21c-bb62-412a-845a-1acade7f7740 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:40.956343 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022d21c-bb62-412a-845a-1acade7f7740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:40.964079 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-3022d21c-bb62-412a-845a-1acade7f7740 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:13:40.964079 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:40.964079 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:40.964079 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:40.964079 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:40.964079 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:40.964079 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:40.964079 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:40.964079 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:40.964079 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:40.964079 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:40.964079 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:40.964079 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:40.964079 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:40.964079 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:40.964079 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:40.965658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:40.965658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:40.965658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:40.965658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:40.965658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:40.965658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:40.965658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:40.965658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:40.965658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:40.965658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:40.965658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:40.965658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:40.965658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:40.965658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:40.965658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:40.965658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:40.966445 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:40.966445 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:40.966445 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:40.966445 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:40.966445 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:40.966445 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:40.966445 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:40.966445 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:40.966445 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:40.966445 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:40.966445 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:13:40.966445 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:13:40.966445 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 94/182] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 24 17:13:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:13:40.968541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022d21c-bb62-412a-845a-1acade7f7740 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:41.001994 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f526c-e4f1-4666-a25f-9cf3f7499e42 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:41.044597 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba918ab1-aee2-446f-af8d-a5928099ef4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:41.045413 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba918ab1-aee2-446f-af8d-a5928099ef4d None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:41.045693 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba918ab1-aee2-446f-af8d-a5928099ef4d None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:41.045966 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba918ab1-aee2-446f-af8d-a5928099ef4d None admin] PATH_INFO: `/v3/users/3d76b2e90106415987b2b47fc32218a0` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:41.047193 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba918ab1-aee2-446f-af8d-a5928099ef4d None admin] RBAC: Authorizing `identity:get_user(user_id=3d76b2e90106415987b2b47fc32218a0)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:41.048707 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba918ab1-aee2-446f-af8d-a5928099ef4d None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:41.054806 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 89/183] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:40 2022] GET /identity/v3/users/3d76b2e90106415987b2b47fc32218a0 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:41.054806 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827cb3d-ba68-4f5d-a2d0-8215687ad5c4 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:41.054806 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827cb3d-ba68-4f5d-a2d0-8215687ad5c4 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:41.054806 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827cb3d-ba68-4f5d-a2d0-8215687ad5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:41.069384 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-5827cb3d-ba68-4f5d-a2d0-8215687ad5c4 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:41.070711 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-5827cb3d-ba68-4f5d-a2d0-8215687ad5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:41.086337 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022d21c-bb62-412a-845a-1acade7f7740 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:41.126888 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:41.134684 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a35ab8-416a-4f5e-b188-643adb159523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:41.135448 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a35ab8-416a-4f5e-b188-643adb159523 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:41.135729 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a35ab8-416a-4f5e-b188-643adb159523 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:41.136111 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a35ab8-416a-4f5e-b188-643adb159523 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:41.137690 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a35ab8-416a-4f5e-b188-643adb159523 None admin] RBAC: Adding query filter params (role.id=ee8d50c25f9347d5b99d4a346f7c2fa8, scope.project.id=20fbbdffa9b84d99b150f2395751706c, user.id=3d76b2e90106415987b2b47fc32218a0) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:41.137998 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a35ab8-416a-4f5e-b188-643adb159523 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:41.139630 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a35ab8-416a-4f5e-b188-643adb159523 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:41.146412 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 95/184] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:13:40 2022] GET /identity/v3/role_assignments?user.id=3d76b2e90106415987b2b47fc32218a0&scope.project.id=20fbbdffa9b84d99b150f2395751706c&role.id=ee8d50c25f9347d5b99d4a346f7c2fa8 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:41.147012 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a35ab8-416a-4f5e-b188-643adb159523 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:41.161851 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 90/185] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:41.163879 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827cb3d-ba68-4f5d-a2d0-8215687ad5c4 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:41.197747 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:41.291374 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a35ab8-416a-4f5e-b188-643adb159523 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:41.306861 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827cb3d-ba68-4f5d-a2d0-8215687ad5c4 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:41.329573 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da5797-a514-4a0a-8fd0-6152aef5609d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:41.330245 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da5797-a514-4a0a-8fd0-6152aef5609d None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:41.330520 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da5797-a514-4a0a-8fd0-6152aef5609d None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:41.330837 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da5797-a514-4a0a-8fd0-6152aef5609d None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:41.331582 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da5797-a514-4a0a-8fd0-6152aef5609d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:41.331879 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da5797-a514-4a0a-8fd0-6152aef5609d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:41.333263 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da5797-a514-4a0a-8fd0-6152aef5609d None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:41.342205 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 96/186] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:13:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:41.342869 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da5797-a514-4a0a-8fd0-6152aef5609d None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:41.357357 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887ea12-068b-4a05-b984-137fb0fb875b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:41.357775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887ea12-068b-4a05-b984-137fb0fb875b None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:41.358043 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887ea12-068b-4a05-b984-137fb0fb875b None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:41.358307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887ea12-068b-4a05-b984-137fb0fb875b None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:41.359250 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887ea12-068b-4a05-b984-137fb0fb875b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:41.359418 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887ea12-068b-4a05-b984-137fb0fb875b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:41.360772 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887ea12-068b-4a05-b984-137fb0fb875b None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:41.371504 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 91/187] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:41.372664 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887ea12-068b-4a05-b984-137fb0fb875b None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:41.423607 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:41.463953 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:41.479559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da5797-a514-4a0a-8fd0-6152aef5609d None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:41.497235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887ea12-068b-4a05-b984-137fb0fb875b None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:41.516616 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50844d-88ba-481f-9724-60dadcc6431b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:41.517264 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50844d-88ba-481f-9724-60dadcc6431b None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:41.517543 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50844d-88ba-481f-9724-60dadcc6431b None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:41.517816 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50844d-88ba-481f-9724-60dadcc6431b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:41.532987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f812b0-7cbc-4e93-bd56-1ee309e8afbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:41.533789 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f812b0-7cbc-4e93-bd56-1ee309e8afbb None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:41.534069 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f812b0-7cbc-4e93-bd56-1ee309e8afbb None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:41.534560 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f812b0-7cbc-4e93-bd56-1ee309e8afbb None admin] PATH_INFO: `/v3/domains/default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:41.535560 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f812b0-7cbc-4e93-bd56-1ee309e8afbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:41.537028 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f812b0-7cbc-4e93-bd56-1ee309e8afbb None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:41.538857 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 92/188] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:13:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:41.539428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f812b0-7cbc-4e93-bd56-1ee309e8afbb None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:41.588318 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50844d-88ba-481f-9724-60dadcc6431b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:41.590062 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50844d-88ba-481f-9724-60dadcc6431b None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:41.648244 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f812b0-7cbc-4e93-bd56-1ee309e8afbb None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:41.655726 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:41.680899 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:41.687002 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd88466-7eb7-4abf-bc98-8644aa740d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:41.687988 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd88466-7eb7-4abf-bc98-8644aa740d90 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:41.688246 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd88466-7eb7-4abf-bc98-8644aa740d90 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:41.688600 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd88466-7eb7-4abf-bc98-8644aa740d90 None admin] PATH_INFO: `/v3/users/911f056efade43eea6af02d5528cb061` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:41.695572 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 97/189] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:13:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:13:41.696587 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50844d-88ba-481f-9724-60dadcc6431b None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:41.707269 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd88466-7eb7-4abf-bc98-8644aa740d90 None admin] RBAC: Authorizing `identity:get_user(user_id=911f056efade43eea6af02d5528cb061)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:41.708741 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd88466-7eb7-4abf-bc98-8644aa740d90 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:41.710602 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 93/190] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:41 2022] GET /identity/v3/users/911f056efade43eea6af02d5528cb061 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:41.711208 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd88466-7eb7-4abf-bc98-8644aa740d90 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:41.817696 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50844d-88ba-481f-9724-60dadcc6431b None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:41.818949 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd88466-7eb7-4abf-bc98-8644aa740d90 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:41.856407 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e8073-2667-40f3-bb14-d41a22257229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:41.857099 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e8073-2667-40f3-bb14-d41a22257229 None admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:41.857465 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e8073-2667-40f3-bb14-d41a22257229 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:41.857781 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e8073-2667-40f3-bb14-d41a22257229 None admin] PATH_INFO: `/v3/users` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:41.858064 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019c9d6-96a9-4554-9a2a-2b06be0b57db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:41.858690 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e8073-2667-40f3-bb14-d41a22257229 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:41.858962 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019c9d6-96a9-4554-9a2a-2b06be0b57db None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:41.859232 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019c9d6-96a9-4554-9a2a-2b06be0b57db None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:41.859493 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019c9d6-96a9-4554-9a2a-2b06be0b57db None admin] PATH_INFO: `/v3/users/911f056efade43eea6af02d5528cb061` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:41.860169 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e8073-2667-40f3-bb14-d41a22257229 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:41.860673 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019c9d6-96a9-4554-9a2a-2b06be0b57db None admin] RBAC: Authorizing `identity:get_user(user_id=911f056efade43eea6af02d5528cb061)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:41.862096 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019c9d6-96a9-4554-9a2a-2b06be0b57db None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:41.868496 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 98/191] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:41 2022] GET /identity/v3/users/911f056efade43eea6af02d5528cb061 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:41.868496 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019c9d6-96a9-4554-9a2a-2b06be0b57db None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:41.885811 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 94/192] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 24 17:13:41 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:13:41.886941 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e8073-2667-40f3-bb14-d41a22257229 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:41.921054 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:41.968314 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:42.032016 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e8073-2667-40f3-bb14-d41a22257229 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:42.032526 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019c9d6-96a9-4554-9a2a-2b06be0b57db None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:42.069765 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d1ac7-0701-42ab-826f-1bf9852a3de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:42.070857 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d1ac7-0701-42ab-826f-1bf9852a3de8 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:42.070963 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821388e-03ca-44c2-b61c-840827d63cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:42.071180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d1ac7-0701-42ab-826f-1bf9852a3de8 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:42.071406 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d1ac7-0701-42ab-826f-1bf9852a3de8 None admin] PATH_INFO: `/v3/projects/06d50bf5f7074d4ab6784ffaf232bbfc` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:42.071555 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821388e-03ca-44c2-b61c-840827d63cbf None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:42.071792 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821388e-03ca-44c2-b61c-840827d63cbf None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:42.072061 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821388e-03ca-44c2-b61c-840827d63cbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:42.072666 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d1ac7-0701-42ab-826f-1bf9852a3de8 None admin] RBAC: Authorizing `identity:get_project(project_id=06d50bf5f7074d4ab6784ffaf232bbfc)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:42.074299 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d1ac7-0701-42ab-826f-1bf9852a3de8 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:42.082972 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 99/193] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:41 2022] GET /identity/v3/projects/06d50bf5f7074d4ab6784ffaf232bbfc => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:42.082972 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d1ac7-0701-42ab-826f-1bf9852a3de8 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:42.157769 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821388e-03ca-44c2-b61c-840827d63cbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:42.159202 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821388e-03ca-44c2-b61c-840827d63cbf None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:42.184033 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:42.207187 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d1ac7-0701-42ab-826f-1bf9852a3de8 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:42.237793 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:42.255305 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fde555-095c-4727-8e05-d76ae41a6167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:42.255958 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fde555-095c-4727-8e05-d76ae41a6167 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:42.256241 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fde555-095c-4727-8e05-d76ae41a6167 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:42.256510 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fde555-095c-4727-8e05-d76ae41a6167 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:42.280754 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 95/194] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:13:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:13:42.281993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658a181-aee2-4b10-a1ff-bbdd2a4eb6e8 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:42.282275 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658a181-aee2-4b10-a1ff-bbdd2a4eb6e8 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:42.282544 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658a181-aee2-4b10-a1ff-bbdd2a4eb6e8 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:42.283926 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 96/195] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:42.284478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658a181-aee2-4b10-a1ff-bbdd2a4eb6e8 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:42.336576 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fde555-095c-4727-8e05-d76ae41a6167 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:42.338363 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fde555-095c-4727-8e05-d76ae41a6167 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:42.431260 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658a181-aee2-4b10-a1ff-bbdd2a4eb6e8 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:42.446905 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 100/196] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:13:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:13:42.448075 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fde555-095c-4727-8e05-d76ae41a6167 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:42.461724 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:42.477428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:42.485457 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd3ada-095a-4885-b7b8-2c139f8a9848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:42.486500 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd3ada-095a-4885-b7b8-2c139f8a9848 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:42.486810 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd3ada-095a-4885-b7b8-2c139f8a9848 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:42.487131 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd3ada-095a-4885-b7b8-2c139f8a9848 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:42.488293 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd3ada-095a-4885-b7b8-2c139f8a9848 None admin] RBAC: Adding query filter params (role.id=ee8d50c25f9347d5b99d4a346f7c2fa8, scope.project.id=06d50bf5f7074d4ab6784ffaf232bbfc, user.id=3d76b2e90106415987b2b47fc32218a0) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:42.488599 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd3ada-095a-4885-b7b8-2c139f8a9848 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:42.490445 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd3ada-095a-4885-b7b8-2c139f8a9848 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:42.500209 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 97/197] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:13:42 2022] GET /identity/v3/role_assignments?user.id=3d76b2e90106415987b2b47fc32218a0&scope.project.id=06d50bf5f7074d4ab6784ffaf232bbfc&role.id=ee8d50c25f9347d5b99d4a346f7c2fa8 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:42.502053 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d1b86-9137-4d40-aaa3-de5aa5e0f069 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:42.502343 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d1b86-9137-4d40-aaa3-de5aa5e0f069 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:42.502642 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d1b86-9137-4d40-aaa3-de5aa5e0f069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:42.525884 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-7e5d1b86-9137-4d40-aaa3-de5aa5e0f069 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:42.527653 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-7e5d1b86-9137-4d40-aaa3-de5aa5e0f069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:42.579987 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fde555-095c-4727-8e05-d76ae41a6167 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:42.602762 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 98/198] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:42.604367 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d1b86-9137-4d40-aaa3-de5aa5e0f069 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:42.624780 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b656cd-1854-4c01-9a02-4f4c18730981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:42.625726 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b656cd-1854-4c01-9a02-4f4c18730981 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:42.626001 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b656cd-1854-4c01-9a02-4f4c18730981 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:42.626269 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b656cd-1854-4c01-9a02-4f4c18730981 None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:42.628385 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b656cd-1854-4c01-9a02-4f4c18730981 None admin] RBAC: Authorizing `identity:get_project(project_id=08f7023404fc4480a32378a0d7e2f040)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:42.630294 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b656cd-1854-4c01-9a02-4f4c18730981 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:42.633071 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 101/199] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:42 2022] GET /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:42.642670 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b656cd-1854-4c01-9a02-4f4c18730981 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:42.764242 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b656cd-1854-4c01-9a02-4f4c18730981 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:42.766873 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:42.807638 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ca3b8-2802-466a-941b-5473cae2c968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:42.808554 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ca3b8-2802-466a-941b-5473cae2c968 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:42.808834 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ca3b8-2802-466a-941b-5473cae2c968 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:42.809106 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ca3b8-2802-466a-941b-5473cae2c968 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:42.810458 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ca3b8-2802-466a-941b-5473cae2c968 None admin] RBAC: Adding query filter params (role.id=bbc0c8e77a594880a35aae1d21773668, scope.project.id=08f7023404fc4480a32378a0d7e2f040, user.id=911f056efade43eea6af02d5528cb061) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:42.810816 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ca3b8-2802-466a-941b-5473cae2c968 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:42.812610 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ca3b8-2802-466a-941b-5473cae2c968 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:42.813075 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d1b86-9137-4d40-aaa3-de5aa5e0f069 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:42.820808 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 102/200] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:13:42 2022] GET /identity/v3/role_assignments?user.id=911f056efade43eea6af02d5528cb061&scope.project.id=08f7023404fc4480a32378a0d7e2f040&role.id=bbc0c8e77a594880a35aae1d21773668 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:42.821605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ca3b8-2802-466a-941b-5473cae2c968 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:42.839185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:42.878490 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1512f22-5970-4676-8018-11a36425740e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:42.879414 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1512f22-5970-4676-8018-11a36425740e None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:42.879690 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1512f22-5970-4676-8018-11a36425740e None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:42.879960 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1512f22-5970-4676-8018-11a36425740e None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:42.883806 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1512f22-5970-4676-8018-11a36425740e None admin] RBAC: Authorizing `identity:get_project(project_id=08f7023404fc4480a32378a0d7e2f040)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:42.888248 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1512f22-5970-4676-8018-11a36425740e None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:42.889800 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 99/201] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:42 2022] GET /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:42.896129 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1512f22-5970-4676-8018-11a36425740e None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:43.039905 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ca3b8-2802-466a-941b-5473cae2c968 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:43.106621 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1512f22-5970-4676-8018-11a36425740e None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:43.122193 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce70a4e-14ff-476a-91a5-5b7519c0ca9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:43.123577 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce70a4e-14ff-476a-91a5-5b7519c0ca9e None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:43.124163 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce70a4e-14ff-476a-91a5-5b7519c0ca9e None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:43.124629 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce70a4e-14ff-476a-91a5-5b7519c0ca9e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:43.138026 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce70a4e-14ff-476a-91a5-5b7519c0ca9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:43.145299 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8d9ed-462d-4155-96f5-9fa8732fc122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:43.145956 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8d9ed-462d-4155-96f5-9fa8732fc122 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:43.146235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8d9ed-462d-4155-96f5-9fa8732fc122 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:43.146506 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8d9ed-462d-4155-96f5-9fa8732fc122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:43.147758 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8d9ed-462d-4155-96f5-9fa8732fc122 None admin] RBAC: Adding query filter params (role.id=ae295b7c396a4e559ecd6d574f097d4a, scope.project.id=08f7023404fc4480a32378a0d7e2f040, user.id=911f056efade43eea6af02d5528cb061) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:43.148068 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8d9ed-462d-4155-96f5-9fa8732fc122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:43.149349 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-7ce70a4e-14ff-476a-91a5-5b7519c0ca9e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 17:13:43.149349 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:43.149349 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:43.149349 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:43.149349 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:43.149349 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:43.149349 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:43.149349 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:43.149349 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:43.149349 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:43.149349 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:43.149349 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:43.149349 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:43.149349 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:43.149349 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:43.149349 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:43.150200 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:43.150200 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:43.150200 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:43.150200 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:43.150200 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:43.150200 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:43.150200 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:43.150200 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:43.150200 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:43.150200 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:43.150200 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:43.150200 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:43.150200 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:43.150200 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:43.150200 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:43.150200 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:43.150992 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:43.150992 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:43.150992 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:43.150992 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:43.150992 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:43.150992 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:43.150992 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:43.150992 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:43.150992 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:43.150992 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:43.150992 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 17:13:43.150992 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:13:43.151715 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8d9ed-462d-4155-96f5-9fa8732fc122 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:43.153629 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 103/202] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:13:43.162654 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 100/203] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:13:42 2022] GET /identity/v3/role_assignments?user.id=911f056efade43eea6af02d5528cb061&scope.project.id=08f7023404fc4480a32378a0d7e2f040&role.id=ae295b7c396a4e559ecd6d574f097d4a => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:13:43.162868 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce70a4e-14ff-476a-91a5-5b7519c0ca9e None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:43.181946 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:43.272252 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce70a4e-14ff-476a-91a5-5b7519c0ca9e None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:43.317895 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba05ceb-eca6-472a-b7d3-edefc51af837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:43.318498 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba05ceb-eca6-472a-b7d3-edefc51af837 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:43.318814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba05ceb-eca6-472a-b7d3-edefc51af837 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:43.319087 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba05ceb-eca6-472a-b7d3-edefc51af837 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:43.319898 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba05ceb-eca6-472a-b7d3-edefc51af837 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:43.320239 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba05ceb-eca6-472a-b7d3-edefc51af837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:43.321650 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba05ceb-eca6-472a-b7d3-edefc51af837 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:43.331230 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 104/204] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:13:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:13:43.337111 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8d9ed-462d-4155-96f5-9fa8732fc122 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:43.391930 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:43.447213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8d9ed-462d-4155-96f5-9fa8732fc122 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:43.489036 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae7fda-af48-4d20-9778-e8f95f898126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:43.489929 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae7fda-af48-4d20-9778-e8f95f898126 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:43.490203 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae7fda-af48-4d20-9778-e8f95f898126 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:43.490470 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae7fda-af48-4d20-9778-e8f95f898126 None admin] PATH_INFO: `/v3/users/a2dc6fa37c7a42b49c96f32fe3622bb4` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:43.491754 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae7fda-af48-4d20-9778-e8f95f898126 None admin] RBAC: Authorizing `identity:get_user(user_id=a2dc6fa37c7a42b49c96f32fe3622bb4)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:43.493449 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae7fda-af48-4d20-9778-e8f95f898126 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:43.495595 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 101/205] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:43 2022] GET /identity/v3/users/a2dc6fa37c7a42b49c96f32fe3622bb4 => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:43.501262 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba05ceb-eca6-472a-b7d3-edefc51af837 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:43.600623 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:43.625306 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba05ceb-eca6-472a-b7d3-edefc51af837 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:43.675925 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa66d6-47a5-4cc6-b31e-cf2216b20500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:43.676583 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa66d6-47a5-4cc6-b31e-cf2216b20500 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:43.676858 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa66d6-47a5-4cc6-b31e-cf2216b20500 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:43.677129 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa66d6-47a5-4cc6-b31e-cf2216b20500 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:43.764508 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa66d6-47a5-4cc6-b31e-cf2216b20500 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:43.765976 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa66d6-47a5-4cc6-b31e-cf2216b20500 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:43.864936 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:43.894322 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 105/206] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:13:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 17:13:43.899152 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae7fda-af48-4d20-9778-e8f95f898126 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:44.008194 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae7fda-af48-4d20-9778-e8f95f898126 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:44.025973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:44.055182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30232507-d420-41b6-9655-37371f2e4bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:44.056050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30232507-d420-41b6-9655-37371f2e4bf4 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:44.056327 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30232507-d420-41b6-9655-37371f2e4bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:44.056595 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30232507-d420-41b6-9655-37371f2e4bf4 None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:44.057807 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30232507-d420-41b6-9655-37371f2e4bf4 None admin] RBAC: Authorizing `identity:get_project(project_id=20fbbdffa9b84d99b150f2395751706c)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:44.059452 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30232507-d420-41b6-9655-37371f2e4bf4 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:44.061169 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 102/207] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:43 2022] GET /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:44.067178 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa66d6-47a5-4cc6-b31e-cf2216b20500 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:44.177141 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa66d6-47a5-4cc6-b31e-cf2216b20500 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:44.211759 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810bbe0-5edb-4eac-8f96-811716b7f391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:44.212417 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810bbe0-5edb-4eac-8f96-811716b7f391 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:44.212693 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810bbe0-5edb-4eac-8f96-811716b7f391 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:44.212963 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810bbe0-5edb-4eac-8f96-811716b7f391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:44.213793 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810bbe0-5edb-4eac-8f96-811716b7f391 None admin] RBAC: Adding query filter params (role.id=b0d58ae775d64617af2ab8d0f0952ea6, scope.project.id=20fbbdffa9b84d99b150f2395751706c, user.id=a2dc6fa37c7a42b49c96f32fe3622bb4) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:44.214132 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810bbe0-5edb-4eac-8f96-811716b7f391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:44.215714 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810bbe0-5edb-4eac-8f96-811716b7f391 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:44.225376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 106/208] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:13:44 2022] GET /identity/v3/role_assignments?user.id=a2dc6fa37c7a42b49c96f32fe3622bb4&scope.project.id=20fbbdffa9b84d99b150f2395751706c&role.id=b0d58ae775d64617af2ab8d0f0952ea6 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:44.864676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe73bc6-719e-4f8e-9c7f-0184c61df5fe None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:44.865088 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe73bc6-719e-4f8e-9c7f-0184c61df5fe None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:44.865321 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe73bc6-719e-4f8e-9c7f-0184c61df5fe None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:44.867011 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 103/209] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:44.874142 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b869e5-0b85-4b66-a13c-69e486f9b548 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:44.874631 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b869e5-0b85-4b66-a13c-69e486f9b548 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:44.874730 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b869e5-0b85-4b66-a13c-69e486f9b548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:44.892041 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-53b869e5-0b85-4b66-a13c-69e486f9b548 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:44.893222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-53b869e5-0b85-4b66-a13c-69e486f9b548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:44.914426 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c3dca-d86e-42c1-ba74-455a5636f648 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:44.914944 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c3dca-d86e-42c1-ba74-455a5636f648 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:44.915050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c3dca-d86e-42c1-ba74-455a5636f648 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:44.916619 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 104/210] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:44.922038 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba73b2-75b0-4ffb-b488-5fdf99968520 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:44.922321 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba73b2-75b0-4ffb-b488-5fdf99968520 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:44.922615 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba73b2-75b0-4ffb-b488-5fdf99968520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:44.941017 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-eeba73b2-75b0-4ffb-b488-5fdf99968520 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:44.942206 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-eeba73b2-75b0-4ffb-b488-5fdf99968520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:44.943950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:44.981302 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 107/211] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:45.006160 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b869e5-0b85-4b66-a13c-69e486f9b548 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:45.026244 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 105/212] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 17:13:45.054682 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba73b2-75b0-4ffb-b488-5fdf99968520 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:45.118339 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b869e5-0b85-4b66-a13c-69e486f9b548 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:45.168887 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4db6e6-a151-4d58-aca7-0e782824633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:45.170674 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4db6e6-a151-4d58-aca7-0e782824633b None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:45.171394 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4db6e6-a151-4d58-aca7-0e782824633b None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:45.171814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4db6e6-a151-4d58-aca7-0e782824633b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:45.179918 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba73b2-75b0-4ffb-b488-5fdf99968520 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:45.185864 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4db6e6-a151-4d58-aca7-0e782824633b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:45.203222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-1c4db6e6-a151-4d58-aca7-0e782824633b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:13:45.203222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:45.203222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:45.203222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:45.203222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:45.203222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:45.203222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:45.203222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:45.203222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:45.203222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:45.203222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:45.203222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:45.203222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:45.203222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:45.203222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:45.203222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:45.204924 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:45.204924 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:45.204924 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:45.204924 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:45.204924 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:45.204924 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:45.204924 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:45.204924 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:45.204924 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:45.204924 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:45.204924 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:45.204924 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:45.204924 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:45.204924 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:45.204924 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:45.204924 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:45.206500 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:45.206500 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:45.206500 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:45.206500 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:45.206500 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:45.206500 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:45.206500 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:45.206500 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:45.206500 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:45.206500 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:45.206500 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:13:45.206500 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:13:45.207718 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:45.210259 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 108/213] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:13:45.217845 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4db6e6-a151-4d58-aca7-0e782824633b None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:45.230970 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2cbc2-3ffd-4a79-8000-e10c1df7a324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:45.232088 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2cbc2-3ffd-4a79-8000-e10c1df7a324 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:45.232464 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2cbc2-3ffd-4a79-8000-e10c1df7a324 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:45.232838 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2cbc2-3ffd-4a79-8000-e10c1df7a324 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:45.234856 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2cbc2-3ffd-4a79-8000-e10c1df7a324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:45.236831 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2cbc2-3ffd-4a79-8000-e10c1df7a324 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:45.242695 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 106/214] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:13:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:13:45.244329 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2cbc2-3ffd-4a79-8000-e10c1df7a324 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:45.270214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:45.369637 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4db6e6-a151-4d58-aca7-0e782824633b None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:45.379243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2cbc2-3ffd-4a79-8000-e10c1df7a324 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:45.410454 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f840e33-55c3-4724-aed8-de731664e51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:45.411862 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f840e33-55c3-4724-aed8-de731664e51d None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:45.412349 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f840e33-55c3-4724-aed8-de731664e51d None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:45.412884 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f840e33-55c3-4724-aed8-de731664e51d None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:45.414007 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f840e33-55c3-4724-aed8-de731664e51d None admin] RBAC: Adding query filter params (name=member) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:45.414513 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f840e33-55c3-4724-aed8-de731664e51d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:45.416197 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f840e33-55c3-4724-aed8-de731664e51d None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:45.423124 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8444065-e2dd-41b9-971f-1d5b65167f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:45.423830 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8444065-e2dd-41b9-971f-1d5b65167f5b None admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:45.424106 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8444065-e2dd-41b9-971f-1d5b65167f5b None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:45.424375 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8444065-e2dd-41b9-971f-1d5b65167f5b None admin] PATH_INFO: `/v3/users` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:45.425912 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8444065-e2dd-41b9-971f-1d5b65167f5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:45.427884 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8444065-e2dd-41b9-971f-1d5b65167f5b None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:45.430441 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 109/215] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:13:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:45.441543 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f840e33-55c3-4724-aed8-de731664e51d None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:45.453007 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 107/216] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 24 17:13:45 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:13:45.559788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:45.567996 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f840e33-55c3-4724-aed8-de731664e51d None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:45.605118 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef92fa3-cc36-4a86-97c4-6b5e44fd9d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:45.606264 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef92fa3-cc36-4a86-97c4-6b5e44fd9d29 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:45.606722 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef92fa3-cc36-4a86-97c4-6b5e44fd9d29 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:45.607162 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef92fa3-cc36-4a86-97c4-6b5e44fd9d29 None admin] PATH_INFO: `/v3/users/7327a7b3389b40f3b281c98bb702ca14` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:45.623123 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef92fa3-cc36-4a86-97c4-6b5e44fd9d29 None admin] RBAC: Authorizing `identity:get_user(user_id=7327a7b3389b40f3b281c98bb702ca14)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:45.624832 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef92fa3-cc36-4a86-97c4-6b5e44fd9d29 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:45.626780 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 110/217] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:45 2022] GET /identity/v3/users/7327a7b3389b40f3b281c98bb702ca14 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:45.635950 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8444065-e2dd-41b9-971f-1d5b65167f5b None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:45.682304 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:45.686924 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1167a9-3f85-4d9c-b6ed-68dfd4789f62 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:45.687202 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1167a9-3f85-4d9c-b6ed-68dfd4789f62 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:45.687474 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1167a9-3f85-4d9c-b6ed-68dfd4789f62 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:45.689279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 111/218] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 17:13:45.695013 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48693cf9-2bbb-464b-8bc4-27c734bc38d6 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:45.695283 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48693cf9-2bbb-464b-8bc4-27c734bc38d6 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:45.695560 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48693cf9-2bbb-464b-8bc4-27c734bc38d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:45.713852 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-48693cf9-2bbb-464b-8bc4-27c734bc38d6 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:45.715088 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-48693cf9-2bbb-464b-8bc4-27c734bc38d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:45.763902 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8444065-e2dd-41b9-971f-1d5b65167f5b None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:45.802808 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 112/219] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 17:13:45.806600 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb873dd-5163-401e-a389-39337b65406e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:45.807279 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb873dd-5163-401e-a389-39337b65406e None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:45.807951 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb873dd-5163-401e-a389-39337b65406e None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:45.808274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb873dd-5163-401e-a389-39337b65406e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:45.823363 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48693cf9-2bbb-464b-8bc4-27c734bc38d6 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:45.908346 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb873dd-5163-401e-a389-39337b65406e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:45.910973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb873dd-5163-401e-a389-39337b65406e None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:45.955441 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:45.966923 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:45.975908 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48693cf9-2bbb-464b-8bc4-27c734bc38d6 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:46.014135 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03fe63-a34c-4f99-9e41-3f964daf20e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:46.015226 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03fe63-a34c-4f99-9e41-3f964daf20e7 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:46.015611 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03fe63-a34c-4f99-9e41-3f964daf20e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:46.016010 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03fe63-a34c-4f99-9e41-3f964daf20e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:46.037498 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03fe63-a34c-4f99-9e41-3f964daf20e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:46.045121 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 108/220] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:13:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:13:46.046472 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-8a03fe63-a34c-4f99-9e41-3f964daf20e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:13:46.046472 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:46.046472 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:46.046472 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:46.046472 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:46.046472 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:46.046472 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:46.046472 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:46.046472 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:46.046472 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:46.046472 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:46.046472 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:46.046472 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:46.046472 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:46.046472 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:46.046472 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:46.047376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:46.047376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:46.047376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:46.047376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:46.047376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:46.047376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:46.047376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:46.047376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:46.047376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:46.047376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:46.047376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:46.047376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:46.047376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:46.047376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:46.047376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:46.047376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:46.048152 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:46.048152 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:46.048152 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:46.048152 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:46.048152 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:46.048152 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:46.048152 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:46.048152 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:46.048152 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:46.048152 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:46.048152 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:13:46.048152 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:13:46.049392 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998ebf3-0ae6-48c5-a2bc-47a926fa38a7 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:46.049828 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998ebf3-0ae6-48c5-a2bc-47a926fa38a7 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:46.050242 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998ebf3-0ae6-48c5-a2bc-47a926fa38a7 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:46.051692 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 109/221] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:46.054641 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 113/222] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 24 17:13:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:13:46.057560 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998ebf3-0ae6-48c5-a2bc-47a926fa38a7 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:46.058307 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53a56c-a1b2-4d55-8de2-9160dc032eb0 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:46.058778 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53a56c-a1b2-4d55-8de2-9160dc032eb0 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:46.059166 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53a56c-a1b2-4d55-8de2-9160dc032eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:46.078011 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-dc53a56c-a1b2-4d55-8de2-9160dc032eb0 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:46.079389 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-dc53a56c-a1b2-4d55-8de2-9160dc032eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:46.154105 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 114/223] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:46.154838 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53a56c-a1b2-4d55-8de2-9160dc032eb0 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:46.204208 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998ebf3-0ae6-48c5-a2bc-47a926fa38a7 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:46.249255 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77a004-761f-45a1-b270-6bab9933e5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:46.250151 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77a004-761f-45a1-b270-6bab9933e5d5 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:46.250428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77a004-761f-45a1-b270-6bab9933e5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:46.250724 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77a004-761f-45a1-b270-6bab9933e5d5 None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:46.253059 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da77a004-761f-45a1-b270-6bab9933e5d5 None admin] RBAC: Authorizing `identity:get_project(project_id=08f7023404fc4480a32378a0d7e2f040)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:46.254673 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da77a004-761f-45a1-b270-6bab9933e5d5 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:46.262206 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 110/224] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:46 2022] GET /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:46.262206 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77a004-761f-45a1-b270-6bab9933e5d5 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:46.265081 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:46.268732 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:46.317369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53a56c-a1b2-4d55-8de2-9160dc032eb0 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:46.370282 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77a004-761f-45a1-b270-6bab9933e5d5 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:46.370827 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cacc8bc-2c1f-44b4-94cf-a09e32f9447e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:46.372021 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacc8bc-2c1f-44b4-94cf-a09e32f9447e None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:46.373385 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacc8bc-2c1f-44b4-94cf-a09e32f9447e None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:46.373874 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacc8bc-2c1f-44b4-94cf-a09e32f9447e None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:46.374851 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cacc8bc-2c1f-44b4-94cf-a09e32f9447e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:46.375348 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cacc8bc-2c1f-44b4-94cf-a09e32f9447e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:46.376938 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cacc8bc-2c1f-44b4-94cf-a09e32f9447e None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:46.389401 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 115/225] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:13:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:46.390536 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cacc8bc-2c1f-44b4-94cf-a09e32f9447e None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:46.405775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf8320-7c36-4249-b96f-1406ab2eea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:46.406824 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf8320-7c36-4249-b96f-1406ab2eea12 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:46.406963 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf8320-7c36-4249-b96f-1406ab2eea12 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:46.407183 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf8320-7c36-4249-b96f-1406ab2eea12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:46.418372 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf8320-7c36-4249-b96f-1406ab2eea12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:46.426141 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-63bf8320-7c36-4249-b96f-1406ab2eea12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:13:46.426141 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:46.426141 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:46.426141 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:46.426141 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:46.426141 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:46.426141 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:46.426141 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:46.426141 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:46.426141 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:46.426141 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:46.426141 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:46.426141 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:46.426141 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:46.426141 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:46.426141 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:46.427050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:46.427050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:46.427050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:46.427050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:46.427050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:46.427050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:46.427050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:46.427050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:46.427050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:46.427050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:46.427050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:46.427050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:46.427050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:46.427050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:46.427050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:46.427050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:46.427837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:46.427837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:46.427837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:46.427837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:46.427837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:46.427837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:46.427837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:46.427837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:46.427837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:46.427837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:46.427837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:13:46.427837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:13:46.427837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 111/226] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 24 17:13:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:13:46.433868 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf8320-7c36-4249-b96f-1406ab2eea12 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:46.499370 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:46.535454 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cacc8bc-2c1f-44b4-94cf-a09e32f9447e None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:46.552622 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf8320-7c36-4249-b96f-1406ab2eea12 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:46.578270 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca45f7f-fb3a-4452-a0a3-e9f1f031ebf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:46.579373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca45f7f-fb3a-4452-a0a3-e9f1f031ebf1 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:46.579834 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca45f7f-fb3a-4452-a0a3-e9f1f031ebf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:46.580282 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca45f7f-fb3a-4452-a0a3-e9f1f031ebf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:46.581904 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca45f7f-fb3a-4452-a0a3-e9f1f031ebf1 None admin] RBAC: Adding query filter params (role.id=ee8d50c25f9347d5b99d4a346f7c2fa8, scope.project.id=08f7023404fc4480a32378a0d7e2f040, user.id=7327a7b3389b40f3b281c98bb702ca14) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:46.582687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca45f7f-fb3a-4452-a0a3-e9f1f031ebf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:46.585099 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca45f7f-fb3a-4452-a0a3-e9f1f031ebf1 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:46.588214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:46.595750 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 116/227] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:13:46 2022] GET /identity/v3/role_assignments?user.id=7327a7b3389b40f3b281c98bb702ca14&scope.project.id=08f7023404fc4480a32378a0d7e2f040&role.id=ee8d50c25f9347d5b99d4a346f7c2fa8 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:46.596771 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca45f7f-fb3a-4452-a0a3-e9f1f031ebf1 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:46.605079 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f4fa7-06ea-49b0-a221-903a3c9609ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:46.606040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f4fa7-06ea-49b0-a221-903a3c9609ed None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:46.606382 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f4fa7-06ea-49b0-a221-903a3c9609ed None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:46.606733 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f4fa7-06ea-49b0-a221-903a3c9609ed None admin] PATH_INFO: `/v3/users/911f056efade43eea6af02d5528cb061` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:46.609765 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f4fa7-06ea-49b0-a221-903a3c9609ed None admin] RBAC: Authorizing `identity:get_user(user_id=911f056efade43eea6af02d5528cb061)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:46.611501 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f4fa7-06ea-49b0-a221-903a3c9609ed None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:46.613615 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 112/228] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:46 2022] GET /identity/v3/users/911f056efade43eea6af02d5528cb061 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:46.618969 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f4fa7-06ea-49b0-a221-903a3c9609ed None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:46.719711 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca45f7f-fb3a-4452-a0a3-e9f1f031ebf1 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:46.761394 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5898e5c-ae66-40d1-85b7-ef656b039e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:46.762727 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5898e5c-ae66-40d1-85b7-ef656b039e0b None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:46.763205 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5898e5c-ae66-40d1-85b7-ef656b039e0b None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:46.763644 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5898e5c-ae66-40d1-85b7-ef656b039e0b None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:46.764559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5898e5c-ae66-40d1-85b7-ef656b039e0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:46.765292 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5898e5c-ae66-40d1-85b7-ef656b039e0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:46.766873 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5898e5c-ae66-40d1-85b7-ef656b039e0b None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:46.777840 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 117/229] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:46.784440 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5898e5c-ae66-40d1-85b7-ef656b039e0b None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:46.858044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:46.865612 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f4fa7-06ea-49b0-a221-903a3c9609ed None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:46.911808 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5898e5c-ae66-40d1-85b7-ef656b039e0b None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:46.940203 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:46.946810 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c46bd0-d346-4ad6-83c0-27590004f616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:46.948319 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c46bd0-d346-4ad6-83c0-27590004f616 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:46.949701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c46bd0-d346-4ad6-83c0-27590004f616 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:46.949701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c46bd0-d346-4ad6-83c0-27590004f616 None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:46.951484 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c46bd0-d346-4ad6-83c0-27590004f616 None admin] RBAC: Authorizing `identity:get_project(project_id=08f7023404fc4480a32378a0d7e2f040)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:46.953080 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c46bd0-d346-4ad6-83c0-27590004f616 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:46.955354 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 113/230] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:46 2022] GET /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040 => generated 302 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:13:46.963533 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c46bd0-d346-4ad6-83c0-27590004f616 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:46.969177 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33f667-bc65-4d9d-bca8-714fa85abab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:46.970106 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33f667-bc65-4d9d-bca8-714fa85abab4 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:46.970380 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33f667-bc65-4d9d-bca8-714fa85abab4 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:46.970678 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33f667-bc65-4d9d-bca8-714fa85abab4 None admin] PATH_INFO: `/v3/users/911f056efade43eea6af02d5528cb061` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:46.972868 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33f667-bc65-4d9d-bca8-714fa85abab4 None admin] RBAC: Authorizing `identity:get_user(user_id=911f056efade43eea6af02d5528cb061)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:46.974490 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33f667-bc65-4d9d-bca8-714fa85abab4 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:46.976412 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 118/231] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:46 2022] GET /identity/v3/users/911f056efade43eea6af02d5528cb061 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:46.983814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33f667-bc65-4d9d-bca8-714fa85abab4 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:47.112362 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c46bd0-d346-4ad6-83c0-27590004f616 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:47.181686 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ac904-87ed-4dad-9974-c5d5b3317bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:47.185270 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ac904-87ed-4dad-9974-c5d5b3317bcf None admin] REQUEST_METHOD: `PUT` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:47.185736 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ac904-87ed-4dad-9974-c5d5b3317bcf None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:47.186191 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ac904-87ed-4dad-9974-c5d5b3317bcf None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040/users/911f056efade43eea6af02d5528cb061/roles/bbc0c8e77a594880a35aae1d21773668` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:47.191187 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ac904-87ed-4dad-9974-c5d5b3317bcf None admin] RBAC: Authorizing `identity:create_grant(project_id=08f7023404fc4480a32378a0d7e2f040, user_id=911f056efade43eea6af02d5528cb061, role_id=bbc0c8e77a594880a35aae1d21773668)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:47.195336 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ac904-87ed-4dad-9974-c5d5b3317bcf None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:47.207156 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33f667-bc65-4d9d-bca8-714fa85abab4 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:47.224468 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 114/232] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 24 17:13:46 2022] PUT /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040/users/911f056efade43eea6af02d5528cb061/roles/bbc0c8e77a594880a35aae1d21773668 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 17:13:47.268149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:47.281539 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7875c-fb9c-468e-b629-90dd9cf21ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:47.282330 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7875c-fb9c-468e-b629-90dd9cf21ca3 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:47.282620 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7875c-fb9c-468e-b629-90dd9cf21ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:47.282884 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7875c-fb9c-468e-b629-90dd9cf21ca3 None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:47.287540 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7875c-fb9c-468e-b629-90dd9cf21ca3 None admin] RBAC: Authorizing `identity:get_project(project_id=08f7023404fc4480a32378a0d7e2f040)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:47.289030 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7875c-fb9c-468e-b629-90dd9cf21ca3 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:47.291171 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 119/233] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:46 2022] GET /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040 => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:47.297160 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ac904-87ed-4dad-9974-c5d5b3317bcf None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:47.372884 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:47.436992 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ac904-87ed-4dad-9974-c5d5b3317bcf None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:47.487466 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d903146-37d5-4e02-8f8a-5cc00cac2402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:47.488373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d903146-37d5-4e02-8f8a-5cc00cac2402 None admin] REQUEST_METHOD: `PUT` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:47.488649 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d903146-37d5-4e02-8f8a-5cc00cac2402 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:47.488924 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d903146-37d5-4e02-8f8a-5cc00cac2402 None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040/users/911f056efade43eea6af02d5528cb061/roles/ae295b7c396a4e559ecd6d574f097d4a` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:47.496411 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d903146-37d5-4e02-8f8a-5cc00cac2402 None admin] RBAC: Authorizing `identity:create_grant(project_id=08f7023404fc4480a32378a0d7e2f040, user_id=911f056efade43eea6af02d5528cb061, role_id=ae295b7c396a4e559ecd6d574f097d4a)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:47.498160 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d903146-37d5-4e02-8f8a-5cc00cac2402 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:47.523428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 115/234] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 24 17:13:47 2022] PUT /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040/users/911f056efade43eea6af02d5528cb061/roles/ae295b7c396a4e559ecd6d574f097d4a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:13:48.318592 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aab52a-a032-41f6-9422-c23e6b9c0a4b None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:48.319100 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aab52a-a032-41f6-9422-c23e6b9c0a4b None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:48.319100 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aab52a-a032-41f6-9422-c23e6b9c0a4b None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:48.320626 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 120/235] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:48.344671 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed8c57-a41a-4e07-83d3-79948bd61664 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:48.345199 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed8c57-a41a-4e07-83d3-79948bd61664 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:48.345199 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed8c57-a41a-4e07-83d3-79948bd61664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:48.367650 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-e8ed8c57-a41a-4e07-83d3-79948bd61664 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:48.368897 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-e8ed8c57-a41a-4e07-83d3-79948bd61664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:48.395483 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213897e1-db4c-4774-8b7a-e492a79f4dbb None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:48.395841 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213897e1-db4c-4774-8b7a-e492a79f4dbb None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:48.396032 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213897e1-db4c-4774-8b7a-e492a79f4dbb None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:48.397709 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 121/236] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:48.402759 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3631f3-40b2-4a07-9f64-7fadc01fe369 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:48.403042 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3631f3-40b2-4a07-9f64-7fadc01fe369 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:48.403314 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3631f3-40b2-4a07-9f64-7fadc01fe369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:48.439633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-4f3631f3-40b2-4a07-9f64-7fadc01fe369 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:48.440965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-4f3631f3-40b2-4a07-9f64-7fadc01fe369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:48.443432 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 116/237] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:48.471622 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed8c57-a41a-4e07-83d3-79948bd61664 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:48.566943 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:48.575808 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 122/238] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:48.612363 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3631f3-40b2-4a07-9f64-7fadc01fe369 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:48.641651 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed8c57-a41a-4e07-83d3-79948bd61664 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:48.702990 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fae6a-901c-4baa-8ad0-a7baa5de71c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:48.704186 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fae6a-901c-4baa-8ad0-a7baa5de71c7 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:48.704687 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fae6a-901c-4baa-8ad0-a7baa5de71c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:48.705150 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fae6a-901c-4baa-8ad0-a7baa5de71c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:48.706555 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4fae6a-901c-4baa-8ad0-a7baa5de71c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:48.708475 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4fae6a-901c-4baa-8ad0-a7baa5de71c7 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:48.710340 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 117/239] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:13:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:48.717246 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fae6a-901c-4baa-8ad0-a7baa5de71c7 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:48.843899 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fae6a-901c-4baa-8ad0-a7baa5de71c7 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:48.876588 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3631f3-40b2-4a07-9f64-7fadc01fe369 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:48.885774 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad8735-88b6-43bb-8e0e-20266a6b7a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:48.886927 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad8735-88b6-43bb-8e0e-20266a6b7a23 None admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:48.887438 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad8735-88b6-43bb-8e0e-20266a6b7a23 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:48.887903 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad8735-88b6-43bb-8e0e-20266a6b7a23 None admin] PATH_INFO: `/v3/users` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:48.888832 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad8735-88b6-43bb-8e0e-20266a6b7a23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:48.890676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad8735-88b6-43bb-8e0e-20266a6b7a23 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:48.894930 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:48.914786 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 118/240] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 24 17:13:48 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:13:48.962988 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b707a7-52b2-4643-b5cb-fdde555977e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:48.964451 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b707a7-52b2-4643-b5cb-fdde555977e6 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:48.964932 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b707a7-52b2-4643-b5cb-fdde555977e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:48.965457 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b707a7-52b2-4643-b5cb-fdde555977e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:48.987108 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:48.989864 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b707a7-52b2-4643-b5cb-fdde555977e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:48.998709 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-a4b707a7-52b2-4643-b5cb-fdde555977e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 17:13:48.998709 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:48.998709 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:48.998709 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:48.998709 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:48.998709 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:48.998709 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:48.998709 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:48.998709 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:48.998709 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:48.998709 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:48.998709 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:48.998709 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:48.998709 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:48.998709 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:48.998709 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:48.999590 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:48.999590 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:48.999590 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:48.999590 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:48.999590 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:48.999590 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:48.999590 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:48.999590 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:48.999590 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:48.999590 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:48.999590 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:48.999590 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:48.999590 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:48.999590 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:48.999590 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:48.999590 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:49.000381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:49.000381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:49.000381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:49.000381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:49.000381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:49.000381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:49.000381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:49.000381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:49.000381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:49.000381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:49.000381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 17:13:49.000381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:13:49.003505 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 123/241] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:13:49.009175 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad8735-88b6-43bb-8e0e-20266a6b7a23 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:49.181761 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad8735-88b6-43bb-8e0e-20266a6b7a23 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:49.233094 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf41a28-df49-44c5-9a46-5af9a3a5dff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:49.234235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf41a28-df49-44c5-9a46-5af9a3a5dff1 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:49.234748 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf41a28-df49-44c5-9a46-5af9a3a5dff1 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:49.235234 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf41a28-df49-44c5-9a46-5af9a3a5dff1 None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:49.236230 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf41a28-df49-44c5-9a46-5af9a3a5dff1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:49.236728 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf41a28-df49-44c5-9a46-5af9a3a5dff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:49.238409 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf41a28-df49-44c5-9a46-5af9a3a5dff1 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:49.251995 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 119/242] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:13:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:49.257589 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b707a7-52b2-4643-b5cb-fdde555977e6 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:49.379265 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b707a7-52b2-4643-b5cb-fdde555977e6 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:49.419676 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2968e-d3da-404f-86ec-58a21ecc530d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:49.420555 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2968e-d3da-404f-86ec-58a21ecc530d None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:49.420833 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2968e-d3da-404f-86ec-58a21ecc530d None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:49.421107 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2968e-d3da-404f-86ec-58a21ecc530d None admin] PATH_INFO: `/v3/users/051c3c11660a4337bedd70937726696c` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:49.438530 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2968e-d3da-404f-86ec-58a21ecc530d None admin] RBAC: Authorizing `identity:get_user(user_id=051c3c11660a4337bedd70937726696c)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:49.439992 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2968e-d3da-404f-86ec-58a21ecc530d None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:49.441815 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 124/243] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:49 2022] GET /identity/v3/users/051c3c11660a4337bedd70937726696c => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:49.447954 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf41a28-df49-44c5-9a46-5af9a3a5dff1 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:49.493517 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:49.576394 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf41a28-df49-44c5-9a46-5af9a3a5dff1 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:49.617691 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a623d-9fb4-4923-bb22-b08a944df126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:49.618351 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a623d-9fb4-4923-bb22-b08a944df126 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:49.618660 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a623d-9fb4-4923-bb22-b08a944df126 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:49.618937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a623d-9fb4-4923-bb22-b08a944df126 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:49.621948 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863ca68-155e-4242-b12f-601540fc1941 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:49.622229 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863ca68-155e-4242-b12f-601540fc1941 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:49.622503 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863ca68-155e-4242-b12f-601540fc1941 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:49.623928 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 125/244] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:49.630766 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cd3c8-696d-4446-a171-aab4fd2eb3aa None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:49.631055 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cd3c8-696d-4446-a171-aab4fd2eb3aa None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:49.631330 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cd3c8-696d-4446-a171-aab4fd2eb3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:49.650043 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-8b0cd3c8-696d-4446-a171-aab4fd2eb3aa None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:49.651451 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-8b0cd3c8-696d-4446-a171-aab4fd2eb3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:49.700700 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:49.712601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a623d-9fb4-4923-bb22-b08a944df126 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:49.714243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a623d-9fb4-4923-bb22-b08a944df126 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:49.732816 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 126/245] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 17:13:49.750860 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:49.761683 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cd3c8-696d-4446-a171-aab4fd2eb3aa None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:49.822134 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 120/246] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:13:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:13:49.827424 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a623d-9fb4-4923-bb22-b08a944df126 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:49.882018 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cd3c8-696d-4446-a171-aab4fd2eb3aa None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:49.925676 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d99e2-f6c6-4784-8dbb-98608be5353b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:49.926746 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d99e2-f6c6-4784-8dbb-98608be5353b None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:49.927074 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d99e2-f6c6-4784-8dbb-98608be5353b None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:49.927354 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d99e2-f6c6-4784-8dbb-98608be5353b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:49.942403 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d99e2-f6c6-4784-8dbb-98608be5353b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:49.951779 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-f33d99e2-f6c6-4784-8dbb-98608be5353b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:13:49.951779 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:49.951779 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:49.951779 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:49.951779 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:49.951779 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:49.951779 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:49.951779 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:49.951779 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:49.951779 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:49.951779 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:49.951779 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:49.951779 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:49.951779 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:49.951779 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:49.951779 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:49.952707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:49.952707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:49.952707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:49.952707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:49.952707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:49.952707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:49.952707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:49.952707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:49.952707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:49.952707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:49.952707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:49.952707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:49.952707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:49.952707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:49.952707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:49.952707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:49.953928 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:49.953928 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:49.953928 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:49.953928 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:49.953928 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:49.953928 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:49.953928 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:49.953928 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:49.953928 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:49.953928 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:49.953928 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:13:49.953928 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:13:49.955235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a623d-9fb4-4923-bb22-b08a944df126 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:49.955382 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 127/247] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:13:49.959288 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d99e2-f6c6-4784-8dbb-98608be5353b None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:49.990485 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e10b1-01a5-4d19-b9a5-a79a9e0b520c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:49.991425 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e10b1-01a5-4d19-b9a5-a79a9e0b520c None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:49.991698 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e10b1-01a5-4d19-b9a5-a79a9e0b520c None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:49.991968 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e10b1-01a5-4d19-b9a5-a79a9e0b520c None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:49.993250 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e10b1-01a5-4d19-b9a5-a79a9e0b520c None admin] RBAC: Authorizing `identity:get_project(project_id=08f7023404fc4480a32378a0d7e2f040)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:49.994829 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e10b1-01a5-4d19-b9a5-a79a9e0b520c None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:49.996549 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 121/248] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:49 2022] GET /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:13:50.000519 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:50.003861 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e10b1-01a5-4d19-b9a5-a79a9e0b520c None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:50.007750 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:50.077397 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d99e2-f6c6-4784-8dbb-98608be5353b None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:50.115840 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ee60f-67d7-4d55-a8de-78186c30e587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:50.116947 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ee60f-67d7-4d55-a8de-78186c30e587 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:50.117203 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ee60f-67d7-4d55-a8de-78186c30e587 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:50.117572 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ee60f-67d7-4d55-a8de-78186c30e587 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:50.118432 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ee60f-67d7-4d55-a8de-78186c30e587 None admin] RBAC: Adding query filter params (name=member) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:50.118874 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ee60f-67d7-4d55-a8de-78186c30e587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:50.120782 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ee60f-67d7-4d55-a8de-78186c30e587 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:50.127226 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e10b1-01a5-4d19-b9a5-a79a9e0b520c None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:50.130978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 128/249] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:13:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:50.137172 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ee60f-67d7-4d55-a8de-78186c30e587 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:50.164702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa6dc5-8ae5-4f9d-a3f5-b8af7f5ec796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:50.165805 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa6dc5-8ae5-4f9d-a3f5-b8af7f5ec796 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:50.166291 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa6dc5-8ae5-4f9d-a3f5-b8af7f5ec796 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:50.166971 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa6dc5-8ae5-4f9d-a3f5-b8af7f5ec796 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:50.168119 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa6dc5-8ae5-4f9d-a3f5-b8af7f5ec796 None admin] RBAC: Adding query filter params (role.id=b0d58ae775d64617af2ab8d0f0952ea6, scope.project.id=08f7023404fc4480a32378a0d7e2f040, user.id=051c3c11660a4337bedd70937726696c) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:50.168595 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa6dc5-8ae5-4f9d-a3f5-b8af7f5ec796 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:50.170373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa6dc5-8ae5-4f9d-a3f5-b8af7f5ec796 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:50.177319 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 122/250] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:13:50 2022] GET /identity/v3/role_assignments?user.id=051c3c11660a4337bedd70937726696c&scope.project.id=08f7023404fc4480a32378a0d7e2f040&role.id=b0d58ae775d64617af2ab8d0f0952ea6 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:50.205318 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0f2fd-359c-4cce-bc97-b0702ccadda6 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:50.205876 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0f2fd-359c-4cce-bc97-b0702ccadda6 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:50.206348 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0f2fd-359c-4cce-bc97-b0702ccadda6 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:50.208221 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 123/251] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 17:13:50.215013 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8bcd7-984a-4edf-aeb4-c682b1ef6d1a None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:50.215618 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8bcd7-984a-4edf-aeb4-c682b1ef6d1a None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:50.216105 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8bcd7-984a-4edf-aeb4-c682b1ef6d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:50.249696 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:50.250077 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-cdb8bcd7-984a-4edf-aeb4-c682b1ef6d1a None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:50.252434 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-cdb8bcd7-984a-4edf-aeb4-c682b1ef6d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:50.254853 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ee60f-67d7-4d55-a8de-78186c30e587 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:50.300185 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad9e65-9069-4074-906d-ea22b76865cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:50.301145 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad9e65-9069-4074-906d-ea22b76865cb None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:50.301426 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad9e65-9069-4074-906d-ea22b76865cb None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:50.301699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad9e65-9069-4074-906d-ea22b76865cb None admin] PATH_INFO: `/v3/users/7327a7b3389b40f3b281c98bb702ca14` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:50.303107 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad9e65-9069-4074-906d-ea22b76865cb None admin] RBAC: Authorizing `identity:get_user(user_id=7327a7b3389b40f3b281c98bb702ca14)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:50.304834 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad9e65-9069-4074-906d-ea22b76865cb None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:50.310620 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 129/252] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:50 2022] GET /identity/v3/users/7327a7b3389b40f3b281c98bb702ca14 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:13:50.312460 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad9e65-9069-4074-906d-ea22b76865cb None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:50.361225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:50.368695 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 124/253] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:50.409408 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8bcd7-984a-4edf-aeb4-c682b1ef6d1a None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:50.425338 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad9e65-9069-4074-906d-ea22b76865cb None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:50.499497 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704af74-8633-4bef-901b-afda5a065390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:50.500279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704af74-8633-4bef-901b-afda5a065390 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:50.501731 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704af74-8633-4bef-901b-afda5a065390 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:50.502248 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704af74-8633-4bef-901b-afda5a065390 None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:50.504638 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d704af74-8633-4bef-901b-afda5a065390 None admin] RBAC: Authorizing `identity:get_project(project_id=08f7023404fc4480a32378a0d7e2f040)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:50.506145 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d704af74-8633-4bef-901b-afda5a065390 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:50.508020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 130/254] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:50 2022] GET /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:50.515590 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704af74-8633-4bef-901b-afda5a065390 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:50.582887 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:50.616529 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8bcd7-984a-4edf-aeb4-c682b1ef6d1a None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:50.685761 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe432b-2e52-4c41-af47-5a699444c7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:50.686704 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe432b-2e52-4c41-af47-5a699444c7c3 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:50.686985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe432b-2e52-4c41-af47-5a699444c7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:50.687262 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe432b-2e52-4c41-af47-5a699444c7c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:50.706160 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704af74-8633-4bef-901b-afda5a065390 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:50.708193 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe432b-2e52-4c41-af47-5a699444c7c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:50.726719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-3afe432b-2e52-4c41-af47-5a699444c7c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:13:50.726719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:50.726719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:50.726719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:50.726719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:50.726719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:50.726719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:50.726719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:50.726719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:50.726719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:50.726719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:50.726719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:50.726719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:50.726719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:50.726719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:50.726719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:50.727648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:50.727648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:50.727648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:50.727648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:50.727648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:50.727648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:50.727648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:50.727648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:50.727648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:50.727648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:50.727648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:50.727648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:50.727648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:50.727648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:50.727648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:50.727648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:50.728755 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:50.728755 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:50.728755 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:50.728755 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:50.728755 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:50.728755 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:50.728755 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:50.728755 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:50.728755 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:50.728755 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:50.728755 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:13:50.728755 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:13:50.731538 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 125/255] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 24 17:13:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:13:50.737367 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe432b-2e52-4c41-af47-5a699444c7c3 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:50.742177 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cf311-9b3f-48d1-98d1-c1ff30dbee42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:50.742912 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cf311-9b3f-48d1-98d1-c1ff30dbee42 None admin] REQUEST_METHOD: `PUT` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:50.743192 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cf311-9b3f-48d1-98d1-c1ff30dbee42 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:50.743466 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cf311-9b3f-48d1-98d1-c1ff30dbee42 None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040/users/7327a7b3389b40f3b281c98bb702ca14/roles/ee8d50c25f9347d5b99d4a346f7c2fa8` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:50.745751 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7cf311-9b3f-48d1-98d1-c1ff30dbee42 None admin] RBAC: Authorizing `identity:create_grant(project_id=08f7023404fc4480a32378a0d7e2f040, user_id=7327a7b3389b40f3b281c98bb702ca14, role_id=ee8d50c25f9347d5b99d4a346f7c2fa8)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:50.747263 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7cf311-9b3f-48d1-98d1-c1ff30dbee42 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:50.761927 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 131/256] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 24 17:13:50 2022] PUT /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040/users/7327a7b3389b40f3b281c98bb702ca14/roles/ee8d50c25f9347d5b99d4a346f7c2fa8 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:13:50.852211 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:50.900227 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe432b-2e52-4c41-af47-5a699444c7c3 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:50.928215 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b550579-22e6-47fe-8e85-175752a1c4ab None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:50.928541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b550579-22e6-47fe-8e85-175752a1c4ab None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:50.928764 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b550579-22e6-47fe-8e85-175752a1c4ab None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:50.930146 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 132/257] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:50.936041 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6b6c3-1807-48de-badd-05d4554da79e None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:50.936574 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6b6c3-1807-48de-badd-05d4554da79e None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:50.936720 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07db67-4698-4098-8cdc-90535e2dac95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:50.937194 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6b6c3-1807-48de-badd-05d4554da79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:50.937572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07db67-4698-4098-8cdc-90535e2dac95 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:50.937911 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07db67-4698-4098-8cdc-90535e2dac95 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:50.938264 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07db67-4698-4098-8cdc-90535e2dac95 None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:50.939111 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07db67-4698-4098-8cdc-90535e2dac95 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:50.939473 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07db67-4698-4098-8cdc-90535e2dac95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:50.941010 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07db67-4698-4098-8cdc-90535e2dac95 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:50.956069 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 126/258] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:13:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:50.959513 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07db67-4698-4098-8cdc-90535e2dac95 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:50.972573 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-0aa6b6c3-1807-48de-badd-05d4554da79e None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:50.973764 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-0aa6b6c3-1807-48de-badd-05d4554da79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:51.110483 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 133/259] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:51.130303 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07db67-4698-4098-8cdc-90535e2dac95 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:51.137382 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6b6c3-1807-48de-badd-05d4554da79e None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:51.164405 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:51.168909 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:51.194601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce709c1b-17dd-4adc-b221-17ca597178f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:51.195588 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce709c1b-17dd-4adc-b221-17ca597178f7 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:51.195878 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce709c1b-17dd-4adc-b221-17ca597178f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:51.196151 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce709c1b-17dd-4adc-b221-17ca597178f7 None admin] PATH_INFO: `/v3/users/911f056efade43eea6af02d5528cb061` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:51.203868 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce709c1b-17dd-4adc-b221-17ca597178f7 None admin] RBAC: Authorizing `identity:get_user(user_id=911f056efade43eea6af02d5528cb061)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:51.204965 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce709c1b-17dd-4adc-b221-17ca597178f7 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:51.207251 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 127/260] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:50 2022] GET /identity/v3/users/911f056efade43eea6af02d5528cb061 => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:51.213802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce709c1b-17dd-4adc-b221-17ca597178f7 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:51.279435 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6b6c3-1807-48de-badd-05d4554da79e None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:51.344657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eba6c6-ba73-4541-89df-6304c57145cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:51.345367 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eba6c6-ba73-4541-89df-6304c57145cd None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:51.345638 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eba6c6-ba73-4541-89df-6304c57145cd None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:51.345909 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eba6c6-ba73-4541-89df-6304c57145cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:51.366421 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eba6c6-ba73-4541-89df-6304c57145cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:51.380411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-69eba6c6-ba73-4541-89df-6304c57145cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:13:51.380411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:51.380411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:51.380411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:51.380411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:51.380411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:51.380411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:51.380411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:51.380411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:51.380411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:51.380411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:51.380411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:51.380411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:51.380411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:51.380411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:51.380411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:51.381279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:51.381279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:51.381279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:51.381279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:51.381279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:51.381279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:51.381279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:51.381279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:51.381279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:51.381279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:51.381279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:51.381279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:51.381279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:51.381279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:51.381279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:51.381279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:51.382073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:51.382073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:51.382073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:51.382073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:51.382073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:51.382073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:51.382073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:51.382073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:51.382073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:51.382073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:51.382073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:13:51.382073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:13:51.382073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 134/261] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 24 17:13:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:13:51.392722 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eba6c6-ba73-4541-89df-6304c57145cd None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:51.413343 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce709c1b-17dd-4adc-b221-17ca597178f7 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:51.493654 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc50624-6cc7-420e-be77-0489fe65e95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:51.494318 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc50624-6cc7-420e-be77-0489fe65e95e None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:51.498156 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc50624-6cc7-420e-be77-0489fe65e95e None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:51.498604 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc50624-6cc7-420e-be77-0489fe65e95e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:51.568660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:51.593714 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eba6c6-ba73-4541-89df-6304c57145cd None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:51.633062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:51.639798 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d04d8-0812-41a4-afd3-fdfb3e495d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:51.640522 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d04d8-0812-41a4-afd3-fdfb3e495d33 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:51.640800 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d04d8-0812-41a4-afd3-fdfb3e495d33 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:51.641071 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d04d8-0812-41a4-afd3-fdfb3e495d33 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:51.641811 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d04d8-0812-41a4-afd3-fdfb3e495d33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:51.642111 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d04d8-0812-41a4-afd3-fdfb3e495d33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:51.643513 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d04d8-0812-41a4-afd3-fdfb3e495d33 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:51.653329 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc50624-6cc7-420e-be77-0489fe65e95e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:51.664792 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 135/262] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:51.665169 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc50624-6cc7-420e-be77-0489fe65e95e None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:51.703966 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d04d8-0812-41a4-afd3-fdfb3e495d33 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:51.844327 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 128/263] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:13:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 17:13:51.850783 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc50624-6cc7-420e-be77-0489fe65e95e None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:51.897112 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d04d8-0812-41a4-afd3-fdfb3e495d33 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:51.973665 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064a779-81ad-42a8-b58d-e5586e98e8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:51.975179 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064a779-81ad-42a8-b58d-e5586e98e8dd None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:51.976475 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064a779-81ad-42a8-b58d-e5586e98e8dd None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:51.977180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064a779-81ad-42a8-b58d-e5586e98e8dd None admin] PATH_INFO: `/v3/users/911f056efade43eea6af02d5528cb061` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:51.985303 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064a779-81ad-42a8-b58d-e5586e98e8dd None admin] RBAC: Authorizing `identity:get_user(user_id=911f056efade43eea6af02d5528cb061)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:51.988114 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064a779-81ad-42a8-b58d-e5586e98e8dd None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:51.994534 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 136/264] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:51 2022] GET /identity/v3/users/911f056efade43eea6af02d5528cb061 => generated 283 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:51.999776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064a779-81ad-42a8-b58d-e5586e98e8dd None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:52.039228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:52.061476 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:52.101199 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc50624-6cc7-420e-be77-0489fe65e95e None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:52.180799 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a2f88-42ca-4bbd-b95f-104b66d69ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:52.183291 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a2f88-42ca-4bbd-b95f-104b66d69ef1 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:52.183291 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a2f88-42ca-4bbd-b95f-104b66d69ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:52.183577 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a2f88-42ca-4bbd-b95f-104b66d69ef1 None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:52.187482 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a2f88-42ca-4bbd-b95f-104b66d69ef1 None admin] RBAC: Authorizing `identity:get_project(project_id=08f7023404fc4480a32378a0d7e2f040)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:52.188953 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a2f88-42ca-4bbd-b95f-104b66d69ef1 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:52.190803 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 129/265] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:51 2022] GET /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040 => generated 302 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:13:52.198762 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a2f88-42ca-4bbd-b95f-104b66d69ef1 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:52.258363 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064a779-81ad-42a8-b58d-e5586e98e8dd None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:52.344171 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdb4c3-ad26-47fe-8b92-e7bc69c1de1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:52.344828 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdb4c3-ad26-47fe-8b92-e7bc69c1de1b None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:52.345104 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdb4c3-ad26-47fe-8b92-e7bc69c1de1b None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:52.345373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdb4c3-ad26-47fe-8b92-e7bc69c1de1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:52.442403 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a2f88-42ca-4bbd-b95f-104b66d69ef1 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:52.511547 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdb4c3-ad26-47fe-8b92-e7bc69c1de1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:52.513197 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdb4c3-ad26-47fe-8b92-e7bc69c1de1b None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:52.531853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39414c57-c432-4303-b818-f967b9733e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:52.532873 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39414c57-c432-4303-b818-f967b9733e05 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:52.533345 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39414c57-c432-4303-b818-f967b9733e05 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:52.533825 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39414c57-c432-4303-b818-f967b9733e05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:52.534876 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39414c57-c432-4303-b818-f967b9733e05 None admin] RBAC: Adding query filter params (role.id=bbc0c8e77a594880a35aae1d21773668, scope.project.id=08f7023404fc4480a32378a0d7e2f040, user.id=911f056efade43eea6af02d5528cb061) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:52.535371 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39414c57-c432-4303-b818-f967b9733e05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:52.536455 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:52.537323 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39414c57-c432-4303-b818-f967b9733e05 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:52.553846 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 130/266] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:13:52 2022] GET /identity/v3/role_assignments?user.id=911f056efade43eea6af02d5528cb061&scope.project.id=08f7023404fc4480a32378a0d7e2f040&role.id=bbc0c8e77a594880a35aae1d21773668 => generated 608 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:52.703533 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 137/267] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:13:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 704 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:13:52.709216 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39414c57-c432-4303-b818-f967b9733e05 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:52.762230 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:52.873354 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39414c57-c432-4303-b818-f967b9733e05 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:52.924871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404635a-6571-4ce6-9cbb-453de3e5b342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:52.926158 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404635a-6571-4ce6-9cbb-453de3e5b342 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:52.926676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404635a-6571-4ce6-9cbb-453de3e5b342 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:52.927174 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404635a-6571-4ce6-9cbb-453de3e5b342 None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:52.931335 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404635a-6571-4ce6-9cbb-453de3e5b342 None admin] RBAC: Authorizing `identity:get_project(project_id=08f7023404fc4480a32378a0d7e2f040)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:52.933166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404635a-6571-4ce6-9cbb-453de3e5b342 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:52.935185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 131/268] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:52 2022] GET /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:52.941467 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdb4c3-ad26-47fe-8b92-e7bc69c1de1b None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:53.029763 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e0c44-efca-469b-b098-1ea948015fae None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:53.030055 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e0c44-efca-469b-b098-1ea948015fae None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:53.030229 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e0c44-efca-469b-b098-1ea948015fae None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:53.033526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 132/269] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:53.038075 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078de28-644b-44c7-8881-9452cde780b7 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:53.038357 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078de28-644b-44c7-8881-9452cde780b7 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:53.038686 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078de28-644b-44c7-8881-9452cde780b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:53.080696 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-0078de28-644b-44c7-8881-9452cde780b7 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:53.081863 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-0078de28-644b-44c7-8881-9452cde780b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:53.090628 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdb4c3-ad26-47fe-8b92-e7bc69c1de1b None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:53.107050 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:53.135119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f7cf8-fa80-482f-bef2-a3f897fe37ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:53.136216 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f7cf8-fa80-482f-bef2-a3f897fe37ba None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:53.136644 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f7cf8-fa80-482f-bef2-a3f897fe37ba None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:53.137219 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f7cf8-fa80-482f-bef2-a3f897fe37ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:53.138239 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f7cf8-fa80-482f-bef2-a3f897fe37ba None admin] RBAC: Adding query filter params (role.id=ae295b7c396a4e559ecd6d574f097d4a, scope.project.id=08f7023404fc4480a32378a0d7e2f040, user.id=911f056efade43eea6af02d5528cb061) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:53.138823 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f7cf8-fa80-482f-bef2-a3f897fe37ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:53.140570 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f7cf8-fa80-482f-bef2-a3f897fe37ba None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:53.148280 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 138/270] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:13:52 2022] GET /identity/v3/role_assignments?user.id=911f056efade43eea6af02d5528cb061&scope.project.id=08f7023404fc4480a32378a0d7e2f040&role.id=ae295b7c396a4e559ecd6d574f097d4a => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:53.165156 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 133/271] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 17:13:53.192045 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f7cf8-fa80-482f-bef2-a3f897fe37ba None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:53.308871 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f7cf8-fa80-482f-bef2-a3f897fe37ba None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:53.346767 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8415fd-680a-4b1c-8d31-beaa53c94984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:53.347665 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8415fd-680a-4b1c-8d31-beaa53c94984 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:53.347943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8415fd-680a-4b1c-8d31-beaa53c94984 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:53.348214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8415fd-680a-4b1c-8d31-beaa53c94984 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:53.349518 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8415fd-680a-4b1c-8d31-beaa53c94984 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:53.351023 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8415fd-680a-4b1c-8d31-beaa53c94984 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:53.352807 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 139/272] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:13:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:53.359027 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078de28-644b-44c7-8881-9452cde780b7 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:53.379069 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:53.395149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3e470-720e-4c2b-8d7a-9fe414fe5d80 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:53.395447 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3e470-720e-4c2b-8d7a-9fe414fe5d80 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:53.395687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3e470-720e-4c2b-8d7a-9fe414fe5d80 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:53.397339 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 140/273] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 17:13:53.404619 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4d22b-7b2b-4470-8f36-4c07d43671d1 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:53.404916 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4d22b-7b2b-4470-8f36-4c07d43671d1 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:53.405719 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4d22b-7b2b-4470-8f36-4c07d43671d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:53.427177 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-80a4d22b-7b2b-4470-8f36-4c07d43671d1 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:53.428503 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-80a4d22b-7b2b-4470-8f36-4c07d43671d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:53.481524 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078de28-644b-44c7-8881-9452cde780b7 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:53.487726 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:53.526695 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 141/274] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 17:13:53.528128 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882a520-09d0-4a92-b255-8e7ea6c387ca None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:53.528413 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882a520-09d0-4a92-b255-8e7ea6c387ca None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:53.528690 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882a520-09d0-4a92-b255-8e7ea6c387ca None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:53.530557 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 142/275] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:53.531943 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c084d-ab03-4944-965d-e48a5ba8a84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:53.532623 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c084d-ab03-4944-965d-e48a5ba8a84e None admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:53.532898 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c084d-ab03-4944-965d-e48a5ba8a84e None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:53.533163 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c084d-ab03-4944-965d-e48a5ba8a84e None admin] PATH_INFO: `/v3/users` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:53.533887 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c084d-ab03-4944-965d-e48a5ba8a84e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:53.536541 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c084d-ab03-4944-965d-e48a5ba8a84e None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:53.536652 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96a203-027e-47ff-8d14-1edec67e33b3 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:53.536652 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96a203-027e-47ff-8d14-1edec67e33b3 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:53.536652 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96a203-027e-47ff-8d14-1edec67e33b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:53.555649 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-1d96a203-027e-47ff-8d14-1edec67e33b3 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:53.557136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-1d96a203-027e-47ff-8d14-1edec67e33b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:53.569944 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 134/276] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 24 17:13:53 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:13:53.570888 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c084d-ab03-4944-965d-e48a5ba8a84e None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:53.637344 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 143/277] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 17:13:53.660883 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96a203-027e-47ff-8d14-1edec67e33b3 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:53.679753 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:53.715703 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c084d-ab03-4944-965d-e48a5ba8a84e None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:53.771521 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54996d-6642-4ab3-b36a-7cdfac91c92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:53.772437 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54996d-6642-4ab3-b36a-7cdfac91c92f None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:53.772925 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54996d-6642-4ab3-b36a-7cdfac91c92f None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:53.773316 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54996d-6642-4ab3-b36a-7cdfac91c92f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:53.784366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96a203-027e-47ff-8d14-1edec67e33b3 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:53.787400 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:53.789798 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54996d-6642-4ab3-b36a-7cdfac91c92f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:53.799588 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-5a54996d-6642-4ab3-b36a-7cdfac91c92f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:13:53.799588 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:53.799588 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:53.799588 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:53.799588 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:53.799588 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:53.799588 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:53.799588 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:53.799588 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:53.799588 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:53.799588 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:53.799588 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:53.799588 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:53.799588 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:53.799588 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:53.799588 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:53.800536 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:53.800536 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:53.800536 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:53.800536 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:53.800536 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:53.800536 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:53.800536 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:53.800536 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:53.800536 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:53.800536 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:53.800536 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:53.800536 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:53.800536 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:53.800536 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:53.800536 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:53.800536 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:53.801371 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:53.801371 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:53.801371 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:53.801371 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:53.801371 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:53.801371 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:53.801371 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:53.801371 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:53.801371 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:53.801371 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:53.801371 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:13:53.801371 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:13:53.802095 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 135/278] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:13:53.807935 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54996d-6642-4ab3-b36a-7cdfac91c92f None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:53.831656 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3027c9-853b-4794-81b9-895f1450037f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:53.832399 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3027c9-853b-4794-81b9-895f1450037f None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:53.832714 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3027c9-853b-4794-81b9-895f1450037f None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:53.832981 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3027c9-853b-4794-81b9-895f1450037f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:53.844401 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3027c9-853b-4794-81b9-895f1450037f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:53.852423 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-1a3027c9-853b-4794-81b9-895f1450037f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 17:13:53.852423 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:53.852423 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:53.852423 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:53.852423 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:53.852423 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:53.852423 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:53.852423 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:53.852423 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:53.852423 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:53.852423 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:53.852423 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:53.852423 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:53.852423 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:53.852423 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:53.852423 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:53.853776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:53.853776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:53.853776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:53.853776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:53.853776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:53.853776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:53.853776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:53.853776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:53.853776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:53.853776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:53.853776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:53.853776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:53.853776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:53.853776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:53.853776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:53.853776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:53.855493 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:53.855493 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:53.855493 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:53.855493 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:53.855493 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:53.855493 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:53.855493 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:53.855493 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:53.855493 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:53.855493 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:53.855493 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 17:13:53.855493 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:13:53.855493 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 144/279] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:13:53.860216 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3027c9-853b-4794-81b9-895f1450037f None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:53.931124 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54996d-6642-4ab3-b36a-7cdfac91c92f None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:53.973707 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01b547-30eb-4a0e-b62f-ecb8fc7c9d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:53.974437 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01b547-30eb-4a0e-b62f-ecb8fc7c9d9c None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:53.974751 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01b547-30eb-4a0e-b62f-ecb8fc7c9d9c None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:53.975025 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01b547-30eb-4a0e-b62f-ecb8fc7c9d9c None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:53.975819 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01b547-30eb-4a0e-b62f-ecb8fc7c9d9c None admin] RBAC: Adding query filter params (name=member) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:53.976121 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01b547-30eb-4a0e-b62f-ecb8fc7c9d9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:53.978651 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01b547-30eb-4a0e-b62f-ecb8fc7c9d9c None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:53.981342 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:53.981689 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3027c9-853b-4794-81b9-895f1450037f None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:53.996412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 136/280] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:13:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:53.997806 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01b547-30eb-4a0e-b62f-ecb8fc7c9d9c None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:54.027318 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfb9dd-d59c-4e5d-967a-09ad92ac5693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:54.027998 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfb9dd-d59c-4e5d-967a-09ad92ac5693 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:54.028277 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfb9dd-d59c-4e5d-967a-09ad92ac5693 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:54.028548 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfb9dd-d59c-4e5d-967a-09ad92ac5693 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:54.029306 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfb9dd-d59c-4e5d-967a-09ad92ac5693 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:54.029608 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfb9dd-d59c-4e5d-967a-09ad92ac5693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:54.031069 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfb9dd-d59c-4e5d-967a-09ad92ac5693 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:54.043236 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 145/281] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:13:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:13:54.050288 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfb9dd-d59c-4e5d-967a-09ad92ac5693 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:54.089483 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:54.131070 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01b547-30eb-4a0e-b62f-ecb8fc7c9d9c None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:54.174226 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91c551-7101-4ea6-a93d-b2a832e02b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:54.175137 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91c551-7101-4ea6-a93d-b2a832e02b6b None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:54.175433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91c551-7101-4ea6-a93d-b2a832e02b6b None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:54.175726 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91c551-7101-4ea6-a93d-b2a832e02b6b None admin] PATH_INFO: `/v3/users/b1ada48e625a48ddb7db2c0ae7fd36da` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:54.186596 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfb9dd-d59c-4e5d-967a-09ad92ac5693 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:54.191188 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91c551-7101-4ea6-a93d-b2a832e02b6b None admin] RBAC: Authorizing `identity:get_user(user_id=b1ada48e625a48ddb7db2c0ae7fd36da)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:54.192369 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91c551-7101-4ea6-a93d-b2a832e02b6b None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:54.194612 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 137/282] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:53 2022] GET /identity/v3/users/b1ada48e625a48ddb7db2c0ae7fd36da => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:54.217091 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91c551-7101-4ea6-a93d-b2a832e02b6b None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:54.232231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d53ff-16ff-4d2e-a95c-f8f425001d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:54.233219 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d53ff-16ff-4d2e-a95c-f8f425001d50 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:54.233598 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d53ff-16ff-4d2e-a95c-f8f425001d50 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:54.233933 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d53ff-16ff-4d2e-a95c-f8f425001d50 None admin] PATH_INFO: `/v3/users/051c3c11660a4337bedd70937726696c` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:54.235265 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d53ff-16ff-4d2e-a95c-f8f425001d50 None admin] RBAC: Authorizing `identity:get_user(user_id=051c3c11660a4337bedd70937726696c)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:54.239038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d53ff-16ff-4d2e-a95c-f8f425001d50 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:54.239038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 146/283] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:54 2022] GET /identity/v3/users/051c3c11660a4337bedd70937726696c => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:54.244667 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d53ff-16ff-4d2e-a95c-f8f425001d50 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:54.335649 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:54.405492 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91c551-7101-4ea6-a93d-b2a832e02b6b None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:54.418129 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:54.426003 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d53ff-16ff-4d2e-a95c-f8f425001d50 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:54.441087 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f2f05-b7a7-4a80-a785-0cf7b6a51bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:54.442115 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f2f05-b7a7-4a80-a785-0cf7b6a51bf9 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:54.442401 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f2f05-b7a7-4a80-a785-0cf7b6a51bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:54.442710 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f2f05-b7a7-4a80-a785-0cf7b6a51bf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:54.443835 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f2f05-b7a7-4a80-a785-0cf7b6a51bf9 None admin] RBAC: Adding query filter params (role.id=ee8d50c25f9347d5b99d4a346f7c2fa8, user.id=b1ada48e625a48ddb7db2c0ae7fd36da, scope.system=all) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:54.444150 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f2f05-b7a7-4a80-a785-0cf7b6a51bf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:54.446061 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f2f05-b7a7-4a80-a785-0cf7b6a51bf9 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:54.452995 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 138/284] 10.222.0.15 () {56 vars in 1308 bytes} [Fri Jun 24 17:13:54 2022] GET /identity/v3/role_assignments?user.id=b1ada48e625a48ddb7db2c0ae7fd36da&scope.system=all&role.id=ee8d50c25f9347d5b99d4a346f7c2fa8 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:13:54.454609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbd941-c6ed-4cd5-b3c2-0b8ea1587aca None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:54.454898 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbd941-c6ed-4cd5-b3c2-0b8ea1587aca None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:54.455177 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbd941-c6ed-4cd5-b3c2-0b8ea1587aca None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:54.456856 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 139/285] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:54.463364 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a4ffb-135a-4548-85ae-6ac09dd2fe6d None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:54.463711 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a4ffb-135a-4548-85ae-6ac09dd2fe6d None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:54.463918 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a4ffb-135a-4548-85ae-6ac09dd2fe6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:54.482790 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741b7ae-c69c-4e93-ac8f-e975182981b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:54.483414 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-e77a4ffb-135a-4548-85ae-6ac09dd2fe6d None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:54.484313 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741b7ae-c69c-4e93-ac8f-e975182981b3 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:54.484640 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-e77a4ffb-135a-4548-85ae-6ac09dd2fe6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:54.485016 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741b7ae-c69c-4e93-ac8f-e975182981b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:54.485474 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741b7ae-c69c-4e93-ac8f-e975182981b3 None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:54.487429 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741b7ae-c69c-4e93-ac8f-e975182981b3 None admin] RBAC: Authorizing `identity:get_project(project_id=08f7023404fc4480a32378a0d7e2f040)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:54.489532 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741b7ae-c69c-4e93-ac8f-e975182981b3 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:54.498619 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 147/286] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:54 2022] GET /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:13:54.500453 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741b7ae-c69c-4e93-ac8f-e975182981b3 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:54.570879 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 140/287] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:54.611349 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a4ffb-135a-4548-85ae-6ac09dd2fe6d None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:54.670920 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741b7ae-c69c-4e93-ac8f-e975182981b3 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:54.691807 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:54.712911 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2337e28-2c96-4713-9b7e-0effe7ad6961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:54.713970 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2337e28-2c96-4713-9b7e-0effe7ad6961 None admin] REQUEST_METHOD: `PUT` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:54.714600 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2337e28-2c96-4713-9b7e-0effe7ad6961 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:54.714711 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2337e28-2c96-4713-9b7e-0effe7ad6961 None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040/users/051c3c11660a4337bedd70937726696c/roles/b0d58ae775d64617af2ab8d0f0952ea6` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:54.721513 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2337e28-2c96-4713-9b7e-0effe7ad6961 None admin] RBAC: Authorizing `identity:create_grant(project_id=08f7023404fc4480a32378a0d7e2f040, user_id=051c3c11660a4337bedd70937726696c, role_id=b0d58ae775d64617af2ab8d0f0952ea6)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:54.723030 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2337e28-2c96-4713-9b7e-0effe7ad6961 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:54.749149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 148/288] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 24 17:13:54 2022] PUT /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040/users/051c3c11660a4337bedd70937726696c/roles/b0d58ae775d64617af2ab8d0f0952ea6 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:13:54.778884 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a4ffb-135a-4548-85ae-6ac09dd2fe6d None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:54.838447 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda24bd9-9c43-451a-ab5d-f8214db227b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:54.839308 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda24bd9-9c43-451a-ab5d-f8214db227b9 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:54.839589 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda24bd9-9c43-451a-ab5d-f8214db227b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:54.839863 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda24bd9-9c43-451a-ab5d-f8214db227b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:54.857476 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda24bd9-9c43-451a-ab5d-f8214db227b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:54.865474 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-cda24bd9-9c43-451a-ab5d-f8214db227b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:13:54.865474 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:54.865474 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:54.865474 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:54.865474 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:54.865474 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:54.865474 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:54.865474 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:54.865474 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:54.865474 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:54.865474 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:54.865474 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:54.865474 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:54.865474 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:54.865474 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:54.865474 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:54.866433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:54.866433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:54.866433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:54.866433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:54.866433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:54.866433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:54.866433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:54.866433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:54.866433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:54.866433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:54.866433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:54.866433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:54.866433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:54.866433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:54.866433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:54.866433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:54.867937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:54.867937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:54.867937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:54.867937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:54.867937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:54.867937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:54.867937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:54.867937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:54.867937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:54.867937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:54.867937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:13:54.867937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:13:54.867937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 141/289] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:13:54.872840 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2337e28-2c96-4713-9b7e-0effe7ad6961 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:54.910710 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:55.034210 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2337e28-2c96-4713-9b7e-0effe7ad6961 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:55.077116 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cf9b3-6e5e-451a-a610-c5b5afe22b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:55.077784 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cf9b3-6e5e-451a-a610-c5b5afe22b0a None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:55.078057 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cf9b3-6e5e-451a-a610-c5b5afe22b0a None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:55.078323 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cf9b3-6e5e-451a-a610-c5b5afe22b0a None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:55.079108 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cf9b3-6e5e-451a-a610-c5b5afe22b0a None admin] RBAC: Adding query filter params (name=member) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:55.079407 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cf9b3-6e5e-451a-a610-c5b5afe22b0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:55.080780 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cf9b3-6e5e-451a-a610-c5b5afe22b0a None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:55.090396 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 149/290] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:13:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:55.099689 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda24bd9-9c43-451a-ab5d-f8214db227b9 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:55.253383 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda24bd9-9c43-451a-ab5d-f8214db227b9 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:55.266260 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:55.305302 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c554df7-5fcf-48a2-ad29-3e0707a3f72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:55.306113 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c554df7-5fcf-48a2-ad29-3e0707a3f72b None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:55.306392 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c554df7-5fcf-48a2-ad29-3e0707a3f72b None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:55.306675 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c554df7-5fcf-48a2-ad29-3e0707a3f72b None admin] PATH_INFO: `/v3/users/7327a7b3389b40f3b281c98bb702ca14` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:55.308718 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c554df7-5fcf-48a2-ad29-3e0707a3f72b None admin] RBAC: Authorizing `identity:get_user(user_id=7327a7b3389b40f3b281c98bb702ca14)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:55.310240 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c554df7-5fcf-48a2-ad29-3e0707a3f72b None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:55.312042 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 142/291] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:55 2022] GET /identity/v3/users/7327a7b3389b40f3b281c98bb702ca14 => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:55.318702 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cf9b3-6e5e-451a-a610-c5b5afe22b0a None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:55.444714 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:55.463997 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cf9b3-6e5e-451a-a610-c5b5afe22b0a None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:55.509134 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17244026-0ee5-4242-9d32-ad5c1f69bee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:55.509877 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17244026-0ee5-4242-9d32-ad5c1f69bee9 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:55.510171 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17244026-0ee5-4242-9d32-ad5c1f69bee9 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:55.510538 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17244026-0ee5-4242-9d32-ad5c1f69bee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:55.596732 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17244026-0ee5-4242-9d32-ad5c1f69bee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:55.598160 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17244026-0ee5-4242-9d32-ad5c1f69bee9 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:55.708546 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:55.729500 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 150/292] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:13:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:13:55.735157 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c554df7-5fcf-48a2-ad29-3e0707a3f72b None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:55.896038 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c554df7-5fcf-48a2-ad29-3e0707a3f72b None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:55.941635 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6367c6-2c45-45c6-b9b2-32af05402b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:55.942511 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6367c6-2c45-45c6-b9b2-32af05402b3a None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:55.942816 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6367c6-2c45-45c6-b9b2-32af05402b3a None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:55.943088 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6367c6-2c45-45c6-b9b2-32af05402b3a None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:55.947482 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6367c6-2c45-45c6-b9b2-32af05402b3a None admin] RBAC: Authorizing `identity:get_project(project_id=08f7023404fc4480a32378a0d7e2f040)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:55.949140 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6367c6-2c45-45c6-b9b2-32af05402b3a None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:55.951324 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 143/293] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:55 2022] GET /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:55.957468 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17244026-0ee5-4242-9d32-ad5c1f69bee9 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:56.101914 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17244026-0ee5-4242-9d32-ad5c1f69bee9 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:56.149718 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63705295-55e0-44e6-9ab8-1f6d9553efbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:56.150367 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63705295-55e0-44e6-9ab8-1f6d9553efbc None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:56.150667 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63705295-55e0-44e6-9ab8-1f6d9553efbc None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:56.150931 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63705295-55e0-44e6-9ab8-1f6d9553efbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:56.151758 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63705295-55e0-44e6-9ab8-1f6d9553efbc None admin] RBAC: Adding query filter params (role.id=ee8d50c25f9347d5b99d4a346f7c2fa8, scope.project.id=08f7023404fc4480a32378a0d7e2f040, user.id=7327a7b3389b40f3b281c98bb702ca14) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:56.152057 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63705295-55e0-44e6-9ab8-1f6d9553efbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:56.153543 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63705295-55e0-44e6-9ab8-1f6d9553efbc None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:56.163425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 151/294] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:13:55 2022] GET /identity/v3/role_assignments?user.id=7327a7b3389b40f3b281c98bb702ca14&scope.project.id=08f7023404fc4480a32378a0d7e2f040&role.id=ee8d50c25f9347d5b99d4a346f7c2fa8 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:56.661566 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fd747-a6bf-4d4d-9c5b-b2a1b0649017 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:56.661973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fd747-a6bf-4d4d-9c5b-b2a1b0649017 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:56.662144 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fd747-a6bf-4d4d-9c5b-b2a1b0649017 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:56.663519 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 144/295] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:56.669103 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36572513-0cd1-4e80-8061-08d75e72abe8 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:56.669432 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36572513-0cd1-4e80-8061-08d75e72abe8 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:56.669707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36572513-0cd1-4e80-8061-08d75e72abe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:56.683861 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327ef58-5fbb-4fd9-81dd-48cf33e0fff9 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:56.684181 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327ef58-5fbb-4fd9-81dd-48cf33e0fff9 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:56.684404 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327ef58-5fbb-4fd9-81dd-48cf33e0fff9 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:56.686212 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 145/296] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:56.690244 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-36572513-0cd1-4e80-8061-08d75e72abe8 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:56.691503 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-36572513-0cd1-4e80-8061-08d75e72abe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:56.691616 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133c866-688a-4f77-8fb9-5e51e4d71e0a None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:56.691911 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133c866-688a-4f77-8fb9-5e51e4d71e0a None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:56.692187 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133c866-688a-4f77-8fb9-5e51e4d71e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:56.713904 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-0133c866-688a-4f77-8fb9-5e51e4d71e0a None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:56.715361 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-0133c866-688a-4f77-8fb9-5e51e4d71e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:56.762640 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:56.764373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:56.794524 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 152/297] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:56.800923 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 146/298] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:56.819520 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36572513-0cd1-4e80-8061-08d75e72abe8 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:56.827004 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133c866-688a-4f77-8fb9-5e51e4d71e0a None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:56.941536 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133c866-688a-4f77-8fb9-5e51e4d71e0a None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:56.945182 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36572513-0cd1-4e80-8061-08d75e72abe8 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:56.980850 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab50b77-2c09-447d-8ff3-796f56a2659c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:56.981654 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab50b77-2c09-447d-8ff3-796f56a2659c None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:56.981930 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab50b77-2c09-447d-8ff3-796f56a2659c None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:56.982203 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab50b77-2c09-447d-8ff3-796f56a2659c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:56.989556 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db887df5-ce13-48c8-a82f-56aca92c68be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:56.991370 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db887df5-ce13-48c8-a82f-56aca92c68be None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:56.991856 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db887df5-ce13-48c8-a82f-56aca92c68be None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:56.992308 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db887df5-ce13-48c8-a82f-56aca92c68be None admin] PATH_INFO: `/v3/domains/default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:56.993701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab50b77-2c09-447d-8ff3-796f56a2659c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:56.994124 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db887df5-ce13-48c8-a82f-56aca92c68be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:56.995809 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db887df5-ce13-48c8-a82f-56aca92c68be None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:57.002271 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-3ab50b77-2c09-447d-8ff3-796f56a2659c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 17:13:57.002271 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:57.002271 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:57.002271 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:57.002271 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:57.002271 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:57.002271 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:57.002271 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:57.002271 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:57.002271 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:57.002271 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:57.002271 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:57.002271 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:57.002271 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:57.002271 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:57.002271 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:57.003165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:57.003165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:57.003165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:57.003165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:57.003165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:57.003165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:57.003165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:57.003165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:57.003165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:57.003165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:57.003165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:57.003165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:57.003165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:57.003165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:57.003165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:57.003165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:57.003973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:57.003973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:57.003973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:57.003973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:57.003973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:57.003973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:57.003973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:57.003973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:57.003973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:57.003973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:57.003973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 17:13:57.003973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:13:57.003973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 147/300] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:13:57.005163 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 153/300] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:13:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:57.008848 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab50b77-2c09-447d-8ff3-796f56a2659c None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:57.010289 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db887df5-ce13-48c8-a82f-56aca92c68be None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:57.055347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:57.089767 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:57.147998 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab50b77-2c09-447d-8ff3-796f56a2659c None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:57.167659 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db887df5-ce13-48c8-a82f-56aca92c68be None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:57.190348 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc700dd-bce9-4260-a518-e0587ba2e6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:57.191399 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc700dd-bce9-4260-a518-e0587ba2e6eb None admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:57.191945 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc700dd-bce9-4260-a518-e0587ba2e6eb None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:57.192409 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc700dd-bce9-4260-a518-e0587ba2e6eb None admin] PATH_INFO: `/v3/groups` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:57.193829 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc700dd-bce9-4260-a518-e0587ba2e6eb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:57.196085 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc700dd-bce9-4260-a518-e0587ba2e6eb None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:57.208266 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ece440-a12c-4c96-9510-2138266897c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:57.208949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ece440-a12c-4c96-9510-2138266897c5 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:57.209244 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ece440-a12c-4c96-9510-2138266897c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:57.209532 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ece440-a12c-4c96-9510-2138266897c5 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:57.210292 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ece440-a12c-4c96-9510-2138266897c5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:57.210769 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ece440-a12c-4c96-9510-2138266897c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:57.212109 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ece440-a12c-4c96-9510-2138266897c5 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:57.226854 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 154/302] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:13:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:13:57.227189 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 148/302] 10.222.0.15 () {60 vars in 1134 bytes} [Fri Jun 24 17:13:57 2022] POST /identity/v3/groups => generated 229 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:13:57.227791 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ece440-a12c-4c96-9510-2138266897c5 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:57.324035 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0838b9d-e7d0-483a-aaa1-0411fa95595b None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:57.324393 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0838b9d-e7d0-483a-aaa1-0411fa95595b None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:57.324611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0838b9d-e7d0-483a-aaa1-0411fa95595b None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:57.330295 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 149/303] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:57.332282 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c18e7a-8fe2-43f1-9bf0-c168c1e71cea None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:57.332568 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c18e7a-8fe2-43f1-9bf0-c168c1e71cea None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:57.332875 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c18e7a-8fe2-43f1-9bf0-c168c1e71cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:57.351580 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-51c18e7a-8fe2-43f1-9bf0-c168c1e71cea None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:57.352670 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-51c18e7a-8fe2-43f1-9bf0-c168c1e71cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:57.359853 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ece440-a12c-4c96-9510-2138266897c5 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:57.374210 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:57.411328 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0df498-27e3-44da-83da-267640ee180f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:57.412977 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0df498-27e3-44da-83da-267640ee180f None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:57.413450 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0df498-27e3-44da-83da-267640ee180f None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:57.413905 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0df498-27e3-44da-83da-267640ee180f None admin] PATH_INFO: `/v3/users/69689b171e6b4c048c6071c1aa4783bc` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:57.432816 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0df498-27e3-44da-83da-267640ee180f None admin] RBAC: Authorizing `identity:get_user(user_id=69689b171e6b4c048c6071c1aa4783bc)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:57.434638 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0df498-27e3-44da-83da-267640ee180f None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:57.436470 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 150/304] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:57.437074 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 155/305] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:57 2022] GET /identity/v3/users/69689b171e6b4c048c6071c1aa4783bc => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:13:57.443963 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c18e7a-8fe2-43f1-9bf0-c168c1e71cea None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:57.457499 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0df498-27e3-44da-83da-267640ee180f None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:57.474805 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:57.576872 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0df498-27e3-44da-83da-267640ee180f None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:57.588241 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c18e7a-8fe2-43f1-9bf0-c168c1e71cea None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:57.623251 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5a290-3f0e-49a0-8a59-1b2552578082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:57.624710 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5a290-3f0e-49a0-8a59-1b2552578082 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:57.625437 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5a290-3f0e-49a0-8a59-1b2552578082 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:57.626292 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5a290-3f0e-49a0-8a59-1b2552578082 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:57.633392 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41798206-ee42-44fe-bca3-5844bf3929f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:57.634115 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41798206-ee42-44fe-bca3-5844bf3929f7 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:57.634326 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41798206-ee42-44fe-bca3-5844bf3929f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:57.634791 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41798206-ee42-44fe-bca3-5844bf3929f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:57.635731 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41798206-ee42-44fe-bca3-5844bf3929f7 None admin] RBAC: Adding query filter params (role.id=b0d58ae775d64617af2ab8d0f0952ea6, user.id=69689b171e6b4c048c6071c1aa4783bc, scope.system=all) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:57.636038 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41798206-ee42-44fe-bca3-5844bf3929f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:57.637534 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41798206-ee42-44fe-bca3-5844bf3929f7 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:57.642547 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5a290-3f0e-49a0-8a59-1b2552578082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:57.643437 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 151/306] 10.222.0.15 () {56 vars in 1308 bytes} [Fri Jun 24 17:13:57 2022] GET /identity/v3/role_assignments?user.id=69689b171e6b4c048c6071c1aa4783bc&scope.system=all&role.id=b0d58ae775d64617af2ab8d0f0952ea6 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:13:57.651369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-7fa5a290-3f0e-49a0-8a59-1b2552578082 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:13:57.651369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:57.651369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:57.651369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:57.651369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:57.651369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:57.651369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:57.651369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:57.651369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:57.651369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:57.651369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:57.651369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:57.651369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:57.651369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:57.651369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:57.651369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:57.652428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:57.652428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:57.652428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:57.652428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:57.652428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:57.652428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:57.652428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:57.652428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:57.652428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:57.652428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:57.652428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:57.652428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:57.652428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:57.652428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:57.652428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:57.652428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:57.653223 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:57.653223 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:57.653223 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:57.653223 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:57.653223 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:57.653223 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:57.653223 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:57.653223 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:57.653223 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:57.653223 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:57.653223 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:13:57.653223 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:13:57.656206 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 156/307] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:13:57.661702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41798206-ee42-44fe-bca3-5844bf3929f7 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:57.747621 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e928c07-2703-48a1-b635-9d4303df3717 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:57.747797 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e928c07-2703-48a1-b635-9d4303df3717 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:57.748080 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e928c07-2703-48a1-b635-9d4303df3717 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:57.749879 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 157/308] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 17:13:57.756251 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70bd481-a8e9-47dc-842a-89e418c9cf26 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:57.756624 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70bd481-a8e9-47dc-842a-89e418c9cf26 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:57.756788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70bd481-a8e9-47dc-842a-89e418c9cf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:57.770652 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:57.778057 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-b70bd481-a8e9-47dc-842a-89e418c9cf26 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:57.779650 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-b70bd481-a8e9-47dc-842a-89e418c9cf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:57.785742 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41798206-ee42-44fe-bca3-5844bf3929f7 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:57.804633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:57.830001 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c9689-0740-469d-a8d0-3426555ff5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:57.830707 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c9689-0740-469d-a8d0-3426555ff5cf None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:57.831026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c9689-0740-469d-a8d0-3426555ff5cf None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:57.831302 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c9689-0740-469d-a8d0-3426555ff5cf None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:57.832167 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c9689-0740-469d-a8d0-3426555ff5cf None admin] RBAC: Adding query filter params (name=member) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:57.832476 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c9689-0740-469d-a8d0-3426555ff5cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:57.833891 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c9689-0740-469d-a8d0-3426555ff5cf None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:57.843974 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 152/309] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:13:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:13:57.849522 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c9689-0740-469d-a8d0-3426555ff5cf None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:57.864470 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 158/310] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:57.890251 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70bd481-a8e9-47dc-842a-89e418c9cf26 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:57.981745 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c9689-0740-469d-a8d0-3426555ff5cf None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:57.999166 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70bd481-a8e9-47dc-842a-89e418c9cf26 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:58.028088 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2532f-35e3-4d7b-8f59-d9b4e5658582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:58.029299 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2532f-35e3-4d7b-8f59-d9b4e5658582 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:58.029753 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2532f-35e3-4d7b-8f59-d9b4e5658582 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:58.030287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2532f-35e3-4d7b-8f59-d9b4e5658582 None admin] PATH_INFO: `/v3/users/b1ada48e625a48ddb7db2c0ae7fd36da` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:58.031865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2532f-35e3-4d7b-8f59-d9b4e5658582 None admin] RBAC: Authorizing `identity:get_user(user_id=b1ada48e625a48ddb7db2c0ae7fd36da)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:58.033499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2532f-35e3-4d7b-8f59-d9b4e5658582 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:58.035926 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 153/311] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:57 2022] GET /identity/v3/users/b1ada48e625a48ddb7db2c0ae7fd36da => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:58.041608 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2532f-35e3-4d7b-8f59-d9b4e5658582 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:58.050122 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec8d83-195b-4d7b-934a-9a7b67df24df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:58.050951 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec8d83-195b-4d7b-934a-9a7b67df24df None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:58.051229 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec8d83-195b-4d7b-934a-9a7b67df24df None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:58.051498 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec8d83-195b-4d7b-934a-9a7b67df24df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:58.062818 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec8d83-195b-4d7b-934a-9a7b67df24df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:13:58.066964 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:58.070609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-28ec8d83-195b-4d7b-934a-9a7b67df24df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 17:13:58.070609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:13:58.070609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:13:58.070609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:13:58.070609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:13:58.070609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:13:58.070609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:13:58.070609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:13:58.070609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:13:58.070609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:13:58.070609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:13:58.070609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:13:58.070609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:13:58.070609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:13:58.070609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:13:58.070609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:13:58.071529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:13:58.071529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:13:58.071529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:13:58.071529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:13:58.071529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:13:58.071529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:13:58.071529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:13:58.071529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:13:58.071529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:13:58.071529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:13:58.071529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:13:58.071529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:13:58.071529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:13:58.071529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:13:58.071529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:13:58.071529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:13:58.073104 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:13:58.073104 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:13:58.073104 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:13:58.073104 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:13:58.073104 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:13:58.073104 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:13:58.073104 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:13:58.073104 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:13:58.073104 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:13:58.073104 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:13:58.073104 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 17:13:58.073104 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:13:58.073104 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 159/312] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:13:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:13:58.079582 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec8d83-195b-4d7b-934a-9a7b67df24df None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:58.107291 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:58.177926 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2532f-35e3-4d7b-8f59-d9b4e5658582 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:58.208521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec8d83-195b-4d7b-934a-9a7b67df24df None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:58.216906 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7a4db-cb71-4b43-8fcf-295b63603395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:58.217907 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7a4db-cb71-4b43-8fcf-295b63603395 None admin] REQUEST_METHOD: `PUT` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:58.218185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7a4db-cb71-4b43-8fcf-295b63603395 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:58.218456 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7a4db-cb71-4b43-8fcf-295b63603395 None admin] PATH_INFO: `/v3/system/users/b1ada48e625a48ddb7db2c0ae7fd36da/roles/ee8d50c25f9347d5b99d4a346f7c2fa8` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:58.220192 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7a4db-cb71-4b43-8fcf-295b63603395 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b1ada48e625a48ddb7db2c0ae7fd36da, role_id=ee8d50c25f9347d5b99d4a346f7c2fa8)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:58.221769 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7a4db-cb71-4b43-8fcf-295b63603395 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:58.238942 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 154/313] 10.222.0.15 () {58 vars in 1334 bytes} [Fri Jun 24 17:13:58 2022] PUT /identity/v3/system/users/b1ada48e625a48ddb7db2c0ae7fd36da/roles/ee8d50c25f9347d5b99d4a346f7c2fa8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:13:58.251019 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8121bf-e3df-4899-8a45-8e3f1ec45c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:58.252039 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8121bf-e3df-4899-8a45-8e3f1ec45c96 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:58.252530 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8121bf-e3df-4899-8a45-8e3f1ec45c96 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:58.252990 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8121bf-e3df-4899-8a45-8e3f1ec45c96 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:58.253943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8121bf-e3df-4899-8a45-8e3f1ec45c96 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:58.254440 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8121bf-e3df-4899-8a45-8e3f1ec45c96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:58.256549 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8121bf-e3df-4899-8a45-8e3f1ec45c96 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:58.268811 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 160/314] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:13:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:13:58.275820 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7a4db-cb71-4b43-8fcf-295b63603395 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:58.378363 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:58.400717 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7a4db-cb71-4b43-8fcf-295b63603395 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:58.439757 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e611042-5836-4565-97f9-60b1d7bfd7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:58.440642 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e611042-5836-4565-97f9-60b1d7bfd7b4 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:58.440929 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e611042-5836-4565-97f9-60b1d7bfd7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:58.441205 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e611042-5836-4565-97f9-60b1d7bfd7b4 None admin] PATH_INFO: `/v3/users/051c3c11660a4337bedd70937726696c` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:58.442447 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e611042-5836-4565-97f9-60b1d7bfd7b4 None admin] RBAC: Authorizing `identity:get_user(user_id=051c3c11660a4337bedd70937726696c)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:58.445134 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e611042-5836-4565-97f9-60b1d7bfd7b4 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:58.445964 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 155/315] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:13:58 2022] GET /identity/v3/users/051c3c11660a4337bedd70937726696c => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:58.452340 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8121bf-e3df-4899-8a45-8e3f1ec45c96 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:58.547311 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:58.570338 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8121bf-e3df-4899-8a45-8e3f1ec45c96 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:58.605287 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac5e57-a507-49b7-979d-a9e45a4337ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:58.605941 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac5e57-a507-49b7-979d-a9e45a4337ac None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:58.606220 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac5e57-a507-49b7-979d-a9e45a4337ac None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:58.606494 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac5e57-a507-49b7-979d-a9e45a4337ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:58.676317 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac5e57-a507-49b7-979d-a9e45a4337ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:58.677778 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac5e57-a507-49b7-979d-a9e45a4337ac None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:58.759095 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:58.778150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 161/316] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:13:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:13:58.783628 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e611042-5836-4565-97f9-60b1d7bfd7b4 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:58.891459 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e611042-5836-4565-97f9-60b1d7bfd7b4 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:58.926537 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975e568-5f2e-4bae-8cbc-bc0f0882c916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:58.927431 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975e568-5f2e-4bae-8cbc-bc0f0882c916 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:58.927707 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975e568-5f2e-4bae-8cbc-bc0f0882c916 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:58.928017 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975e568-5f2e-4bae-8cbc-bc0f0882c916 None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:58.929201 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975e568-5f2e-4bae-8cbc-bc0f0882c916 None admin] RBAC: Authorizing `identity:get_project(project_id=08f7023404fc4480a32378a0d7e2f040)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:58.930686 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975e568-5f2e-4bae-8cbc-bc0f0882c916 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:58.937371 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 156/317] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:13:58 2022] GET /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:58.938767 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac5e57-a507-49b7-979d-a9e45a4337ac None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:59.040329 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac5e57-a507-49b7-979d-a9e45a4337ac None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:13:59.074455 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e0a53-601a-4ee9-93e9-8fded1525ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:13:59.075145 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e0a53-601a-4ee9-93e9-8fded1525ec9 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:59.075430 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e0a53-601a-4ee9-93e9-8fded1525ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:59.075710 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e0a53-601a-4ee9-93e9-8fded1525ec9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:59.076552 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e0a53-601a-4ee9-93e9-8fded1525ec9 None admin] RBAC: Adding query filter params (role.id=b0d58ae775d64617af2ab8d0f0952ea6, scope.project.id=08f7023404fc4480a32378a0d7e2f040, user.id=051c3c11660a4337bedd70937726696c) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:13:59.076861 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e0a53-601a-4ee9-93e9-8fded1525ec9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:13:59.078453 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e0a53-601a-4ee9-93e9-8fded1525ec9 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:13:59.084486 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 162/318] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:13:58 2022] GET /identity/v3/role_assignments?user.id=051c3c11660a4337bedd70937726696c&scope.project.id=08f7023404fc4480a32378a0d7e2f040&role.id=b0d58ae775d64617af2ab8d0f0952ea6 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:13:59.755406 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ad1c6-5f75-4c43-98cd-aa423c7160c7 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:59.756046 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ad1c6-5f75-4c43-98cd-aa423c7160c7 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:59.756046 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ad1c6-5f75-4c43-98cd-aa423c7160c7 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:59.758394 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 157/319] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:59.765177 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3b445-15c4-42ed-b17f-23b010bf6a4d None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:59.765501 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3b445-15c4-42ed-b17f-23b010bf6a4d None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:59.765722 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3b445-15c4-42ed-b17f-23b010bf6a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:59.786303 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-a8b3b445-15c4-42ed-b17f-23b010bf6a4d None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:13:59.787555 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-a8b3b445-15c4-42ed-b17f-23b010bf6a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:13:59.827479 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:59.861614 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 163/320] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:13:59.885677 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ad1c6-5f75-4c43-98cd-aa423c7160c7 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:13:59.911135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:13:59.977399 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82544f85-7ae2-454a-9f24-62b4bb1862ca None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:59.978332 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82544f85-7ae2-454a-9f24-62b4bb1862ca None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:59.978698 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82544f85-7ae2-454a-9f24-62b4bb1862ca None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:59.980592 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 164/321] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:13:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:13:59.985710 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8c85d-eec5-4a41-a5ec-903a1ac091d4 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:13:59.986166 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8c85d-eec5-4a41-a5ec-903a1ac091d4 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:13:59.986441 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8c85d-eec5-4a41-a5ec-903a1ac091d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:13:59.998554 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ad1c6-5f75-4c43-98cd-aa423c7160c7 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:00.003315 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-5ce8c85d-eec5-4a41-a5ec-903a1ac091d4 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:00.004539 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-5ce8c85d-eec5-4a41-a5ec-903a1ac091d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:00.043452 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcaa33-105e-4e7a-a063-bfa837357d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:00.044253 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcaa33-105e-4e7a-a063-bfa837357d96 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:00.044530 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcaa33-105e-4e7a-a063-bfa837357d96 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:00.044796 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcaa33-105e-4e7a-a063-bfa837357d96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:00.045942 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcaa33-105e-4e7a-a063-bfa837357d96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:00.047416 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcaa33-105e-4e7a-a063-bfa837357d96 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:00.049028 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 158/322] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:13:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:00.054425 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcaa33-105e-4e7a-a063-bfa837357d96 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:00.081446 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 165/323] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:00.105756 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8c85d-eec5-4a41-a5ec-903a1ac091d4 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:00.145057 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:00.161409 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcaa33-105e-4e7a-a063-bfa837357d96 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:00.197211 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4e877-d391-45b3-9111-a3cb4ffd9679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:00.197977 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4e877-d391-45b3-9111-a3cb4ffd9679 None admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:00.198258 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4e877-d391-45b3-9111-a3cb4ffd9679 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:00.198534 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4e877-d391-45b3-9111-a3cb4ffd9679 None admin] PATH_INFO: `/v3/groups` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:00.199313 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4e877-d391-45b3-9111-a3cb4ffd9679 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:00.200928 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4e877-d391-45b3-9111-a3cb4ffd9679 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:00.211130 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8c85d-eec5-4a41-a5ec-903a1ac091d4 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:00.213973 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:00.218657 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 159/324] 10.222.0.15 () {60 vars in 1134 bytes} [Fri Jun 24 17:14:00 2022] POST /identity/v3/groups => generated 226 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 17:14:00.259334 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2ae22-3e13-460b-a990-61786c0847af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:00.260301 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2ae22-3e13-460b-a990-61786c0847af None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:00.260672 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2ae22-3e13-460b-a990-61786c0847af None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:00.260871 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2ae22-3e13-460b-a990-61786c0847af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:00.273578 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2ae22-3e13-460b-a990-61786c0847af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:00.281990 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-73c2ae22-3e13-460b-a990-61786c0847af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 17:14:00.281990 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:00.281990 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:00.281990 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:00.281990 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:00.281990 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:00.281990 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:00.281990 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:00.281990 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:00.281990 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:00.281990 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:00.281990 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:00.281990 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:00.281990 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:00.281990 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:00.281990 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:00.282978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:00.282978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:00.282978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:00.282978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:00.282978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:00.282978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:00.282978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:00.282978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:00.282978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:00.282978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:00.282978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:00.282978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:00.282978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:00.282978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:00.282978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:00.282978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:00.283780 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:00.283780 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:00.283780 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:00.283780 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:00.283780 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:00.283780 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:00.283780 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:00.283780 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:00.283780 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:00.283780 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:00.283780 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 17:14:00.283780 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:00.283780 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 166/325] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:14:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:14:00.289372 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4e877-d391-45b3-9111-a3cb4ffd9679 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:00.404973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4e877-d391-45b3-9111-a3cb4ffd9679 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:00.444347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7070eff-1a32-49c0-a62d-3dd6e5fd6d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:00.445015 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7070eff-1a32-49c0-a62d-3dd6e5fd6d11 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:00.446004 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7070eff-1a32-49c0-a62d-3dd6e5fd6d11 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:00.446004 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7070eff-1a32-49c0-a62d-3dd6e5fd6d11 None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:00.446282 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7070eff-1a32-49c0-a62d-3dd6e5fd6d11 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:00.446608 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7070eff-1a32-49c0-a62d-3dd6e5fd6d11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:00.448539 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7070eff-1a32-49c0-a62d-3dd6e5fd6d11 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:00.459103 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 160/326] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:14:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:00.464900 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2ae22-3e13-460b-a990-61786c0847af None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:00.582774 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2ae22-3e13-460b-a990-61786c0847af None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:00.616281 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a729e94-2961-4562-9d73-08e24a90c160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:00.617155 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a729e94-2961-4562-9d73-08e24a90c160 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:00.617435 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a729e94-2961-4562-9d73-08e24a90c160 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:00.617708 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a729e94-2961-4562-9d73-08e24a90c160 None admin] PATH_INFO: `/v3/users/69689b171e6b4c048c6071c1aa4783bc` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:00.618965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a729e94-2961-4562-9d73-08e24a90c160 None admin] RBAC: Authorizing `identity:get_user(user_id=69689b171e6b4c048c6071c1aa4783bc)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:00.620638 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a729e94-2961-4562-9d73-08e24a90c160 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:00.622488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 167/327] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:14:00 2022] GET /identity/v3/users/69689b171e6b4c048c6071c1aa4783bc => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:00.628778 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7070eff-1a32-49c0-a62d-3dd6e5fd6d11 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:00.642186 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:00.743177 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7070eff-1a32-49c0-a62d-3dd6e5fd6d11 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:00.779324 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796eee4-f1ec-4d0f-959b-5920b8f45288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:00.780927 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796eee4-f1ec-4d0f-959b-5920b8f45288 None admin] REQUEST_METHOD: `PUT` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:00.781361 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796eee4-f1ec-4d0f-959b-5920b8f45288 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:00.781772 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796eee4-f1ec-4d0f-959b-5920b8f45288 None admin] PATH_INFO: `/v3/system/users/69689b171e6b4c048c6071c1aa4783bc/roles/b0d58ae775d64617af2ab8d0f0952ea6` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:00.783565 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796eee4-f1ec-4d0f-959b-5920b8f45288 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=69689b171e6b4c048c6071c1aa4783bc, role_id=b0d58ae775d64617af2ab8d0f0952ea6)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:00.785209 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796eee4-f1ec-4d0f-959b-5920b8f45288 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:00.792553 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbb0c5-6dc2-46c0-b3b8-d825977deda4 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:00.793368 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbb0c5-6dc2-46c0-b3b8-d825977deda4 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:00.793988 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbb0c5-6dc2-46c0-b3b8-d825977deda4 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:00.795713 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 168/328] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:00.799540 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 161/329] 10.222.0.15 () {58 vars in 1334 bytes} [Fri Jun 24 17:14:00 2022] PUT /identity/v3/system/users/69689b171e6b4c048c6071c1aa4783bc/roles/b0d58ae775d64617af2ab8d0f0952ea6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:14:00.802425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cbe58-65b7-445f-8f06-b5a362255614 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:00.802819 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cbe58-65b7-445f-8f06-b5a362255614 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:00.803203 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cbe58-65b7-445f-8f06-b5a362255614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:00.825173 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-879cbe58-65b7-445f-8f06-b5a362255614 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:00.826422 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-879cbe58-65b7-445f-8f06-b5a362255614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:00.861609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:00.916590 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 169/330] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:00.942282 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796eee4-f1ec-4d0f-959b-5920b8f45288 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:01.027368 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:01.064645 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796eee4-f1ec-4d0f-959b-5920b8f45288 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:01.100027 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65922e9f-63ca-4724-9d75-1aa6d6706137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:01.100825 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65922e9f-63ca-4724-9d75-1aa6d6706137 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:01.101106 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65922e9f-63ca-4724-9d75-1aa6d6706137 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:01.101375 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65922e9f-63ca-4724-9d75-1aa6d6706137 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:01.112723 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65922e9f-63ca-4724-9d75-1aa6d6706137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:01.120619 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-65922e9f-63ca-4724-9d75-1aa6d6706137 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:14:01.120619 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:01.120619 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:01.120619 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:01.120619 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:01.120619 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:01.120619 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:01.120619 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:01.120619 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:01.120619 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:01.120619 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:01.120619 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:01.120619 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:01.120619 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:01.120619 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:01.120619 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:01.121565 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:01.121565 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:01.121565 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:01.121565 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:01.121565 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:01.121565 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:01.121565 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:01.121565 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:01.121565 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:01.121565 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:01.121565 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:01.121565 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:01.121565 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:01.121565 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:01.121565 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:01.121565 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:01.122394 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:01.122394 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:01.122394 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:01.122394 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:01.122394 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:01.122394 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:01.122394 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:01.122394 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:01.122394 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:01.122394 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:01.122394 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:14:01.122394 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:01.122394 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 162/331] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:14:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:01.127690 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cbe58-65b7-445f-8f06-b5a362255614 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:01.238443 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cbe58-65b7-445f-8f06-b5a362255614 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:01.279273 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77038dc0-3178-40dc-9c8f-276924d50510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:01.279955 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77038dc0-3178-40dc-9c8f-276924d50510 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:01.280232 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77038dc0-3178-40dc-9c8f-276924d50510 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:01.280505 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77038dc0-3178-40dc-9c8f-276924d50510 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:01.281248 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77038dc0-3178-40dc-9c8f-276924d50510 None admin] RBAC: Adding query filter params (name=member) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:01.281548 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77038dc0-3178-40dc-9c8f-276924d50510 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:01.282985 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77038dc0-3178-40dc-9c8f-276924d50510 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:01.292533 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 170/332] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:14:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:01.298028 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65922e9f-63ca-4724-9d75-1aa6d6706137 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:01.422786 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65922e9f-63ca-4724-9d75-1aa6d6706137 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:01.455100 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:01.459778 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa733a0-715e-4e0d-b253-73cb43d09002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:01.460736 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa733a0-715e-4e0d-b253-73cb43d09002 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:01.461351 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa733a0-715e-4e0d-b253-73cb43d09002 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:01.461666 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa733a0-715e-4e0d-b253-73cb43d09002 None admin] PATH_INFO: `/v3/users/b1ada48e625a48ddb7db2c0ae7fd36da` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:01.463006 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa733a0-715e-4e0d-b253-73cb43d09002 None admin] RBAC: Authorizing `identity:get_user(user_id=b1ada48e625a48ddb7db2c0ae7fd36da)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:01.465042 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa733a0-715e-4e0d-b253-73cb43d09002 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:01.467133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 163/333] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:14:01 2022] GET /identity/v3/users/b1ada48e625a48ddb7db2c0ae7fd36da => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:01.472886 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77038dc0-3178-40dc-9c8f-276924d50510 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:01.500022 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:01.591341 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77038dc0-3178-40dc-9c8f-276924d50510 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:01.629286 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f22a1-d347-4e1f-b441-3ec884726eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:01.629994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f22a1-d347-4e1f-b441-3ec884726eba None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:01.630270 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f22a1-d347-4e1f-b441-3ec884726eba None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:01.630606 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f22a1-d347-4e1f-b441-3ec884726eba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:01.631442 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f22a1-d347-4e1f-b441-3ec884726eba None admin] RBAC: Adding query filter params (role.id=ee8d50c25f9347d5b99d4a346f7c2fa8, user.id=b1ada48e625a48ddb7db2c0ae7fd36da, scope.system=all) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:01.631748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f22a1-d347-4e1f-b441-3ec884726eba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:01.633297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f22a1-d347-4e1f-b441-3ec884726eba None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:01.646704 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 171/334] 10.222.0.15 () {56 vars in 1308 bytes} [Fri Jun 24 17:14:01 2022] GET /identity/v3/role_assignments?user.id=b1ada48e625a48ddb7db2c0ae7fd36da&scope.system=all&role.id=ee8d50c25f9347d5b99d4a346f7c2fa8 => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:03.837652 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8bd19-13cf-48b5-9e92-cf18e1fea6d8 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:03.838761 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8bd19-13cf-48b5-9e92-cf18e1fea6d8 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:03.839276 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8bd19-13cf-48b5-9e92-cf18e1fea6d8 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:03.841385 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 164/335] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:03.860588 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7dd04-0d92-432f-ba0d-e3867870899f None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:03.861529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7dd04-0d92-432f-ba0d-e3867870899f None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:03.862018 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7dd04-0d92-432f-ba0d-e3867870899f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:03.883583 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-b9a7dd04-0d92-432f-ba0d-e3867870899f None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:03.885442 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-b9a7dd04-0d92-432f-ba0d-e3867870899f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:03.963830 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b8d7e-7d05-4a92-b8c3-e336414210b4 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:03.964514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b8d7e-7d05-4a92-b8c3-e336414210b4 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:03.965130 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b8d7e-7d05-4a92-b8c3-e336414210b4 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:03.969601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 165/336] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:03.973089 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 172/337] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:03.976074 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb877d4-5115-44fd-a1b4-7218943f195d None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:03.976614 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb877d4-5115-44fd-a1b4-7218943f195d None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:03.977196 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb877d4-5115-44fd-a1b4-7218943f195d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:04.001743 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7ec88-cec1-4419-81c0-0356b748b7b0 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:04.002343 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7ec88-cec1-4419-81c0-0356b748b7b0 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:04.002827 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7ec88-cec1-4419-81c0-0356b748b7b0 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:04.004768 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 173/338] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:04.010175 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7ec88-cec1-4419-81c0-0356b748b7b0 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:04.015379 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-5cb877d4-5115-44fd-a1b4-7218943f195d None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:04.016912 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-5cb877d4-5115-44fd-a1b4-7218943f195d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:04.024298 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:04.124270 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 166/339] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 17:14:04.127970 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f57cb4-9110-434d-bd13-ccac0f9f2439 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:04.128471 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f57cb4-9110-434d-bd13-ccac0f9f2439 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:04.128889 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f57cb4-9110-434d-bd13-ccac0f9f2439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:04.157216 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-f4f57cb4-9110-434d-bd13-ccac0f9f2439 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:04.158711 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-f4f57cb4-9110-434d-bd13-ccac0f9f2439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:04.183337 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7ec88-cec1-4419-81c0-0356b748b7b0 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:04.236431 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288d866-502d-47c5-8cc6-187197f13d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:04.237892 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288d866-502d-47c5-8cc6-187197f13d43 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:04.238619 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288d866-502d-47c5-8cc6-187197f13d43 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:04.239457 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288d866-502d-47c5-8cc6-187197f13d43 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:04.246995 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 167/340] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:04.249033 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dacc4-34a5-46c4-8ae3-1cbb54806397 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:04.249523 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dacc4-34a5-46c4-8ae3-1cbb54806397 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:04.249978 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dacc4-34a5-46c4-8ae3-1cbb54806397 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:04.251604 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 168/341] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:04.253200 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288d866-502d-47c5-8cc6-187197f13d43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:04.253449 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dacc4-34a5-46c4-8ae3-1cbb54806397 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:04.264094 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-a288d866-502d-47c5-8cc6-187197f13d43 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:14:04.264094 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:04.264094 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:04.264094 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:04.264094 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:04.264094 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:04.264094 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:04.264094 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:04.264094 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:04.264094 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:04.264094 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:04.264094 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:04.264094 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:04.264094 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:04.264094 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:04.264094 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:04.265002 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:04.265002 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:04.265002 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:04.265002 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:04.265002 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:04.265002 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:04.265002 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:04.265002 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:04.265002 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:04.265002 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:04.265002 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:04.265002 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:04.265002 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:04.265002 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:04.265002 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:04.265002 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:04.265836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:04.265836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:04.265836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:04.265836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:04.265836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:04.265836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:04.265836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:04.265836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:04.265836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:04.265836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:04.265836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:14:04.265836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:04.268681 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 174/342] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 24 17:14:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:14:04.270181 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30afa8-f088-41e2-be5b-64165b73d96e None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:04.270722 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30afa8-f088-41e2-be5b-64165b73d96e None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:04.271198 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30afa8-f088-41e2-be5b-64165b73d96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:04.295639 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-df30afa8-f088-41e2-be5b-64165b73d96e None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:04.297331 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-df30afa8-f088-41e2-be5b-64165b73d96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:04.334853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:04.372198 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:04.379660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 175/343] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:04.380692 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30afa8-f088-41e2-be5b-64165b73d96e None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:04.400321 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dacc4-34a5-46c4-8ae3-1cbb54806397 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:04.442866 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5d1a8-fc1c-4c16-8956-e3bc0f3b6d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:04.443970 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5d1a8-fc1c-4c16-8956-e3bc0f3b6d3f None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:04.444408 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5d1a8-fc1c-4c16-8956-e3bc0f3b6d3f None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:04.444828 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5d1a8-fc1c-4c16-8956-e3bc0f3b6d3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:04.458839 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5d1a8-fc1c-4c16-8956-e3bc0f3b6d3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:04.468373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-2da5d1a8-fc1c-4c16-8956-e3bc0f3b6d3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:14:04.468373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:04.468373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:04.468373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:04.468373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:04.468373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:04.468373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:04.468373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:04.468373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:04.468373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:04.468373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:04.468373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:04.468373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:04.468373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:04.468373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:04.468373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:04.469514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:04.469514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:04.469514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:04.469514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:04.469514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:04.469514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:04.469514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:04.469514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:04.469514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:04.469514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:04.469514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:04.469514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:04.469514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:04.469514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:04.469514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:04.469514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:04.470528 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:04.470528 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:04.470528 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:04.470528 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:04.470528 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:04.470528 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:04.470528 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:04.470528 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:04.470528 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:04.470528 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:04.470528 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:14:04.470528 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:04.474036 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 169/344] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:14:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:04.479393 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5d1a8-fc1c-4c16-8956-e3bc0f3b6d3f None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:04.504489 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30afa8-f088-41e2-be5b-64165b73d96e None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:04.548171 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b2f09-0d64-4146-b1ad-46b5bd92bd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:04.548619 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b2f09-0d64-4146-b1ad-46b5bd92bd76 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:04.548898 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b2f09-0d64-4146-b1ad-46b5bd92bd76 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:04.549174 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b2f09-0d64-4146-b1ad-46b5bd92bd76 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:04.549928 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b2f09-0d64-4146-b1ad-46b5bd92bd76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:04.550224 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b2f09-0d64-4146-b1ad-46b5bd92bd76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:04.551889 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b2f09-0d64-4146-b1ad-46b5bd92bd76 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:04.569115 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 176/345] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:04.569830 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b2f09-0d64-4146-b1ad-46b5bd92bd76 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:04.619232 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5d1a8-fc1c-4c16-8956-e3bc0f3b6d3f None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:04.643503 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:04.646880 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:04.663960 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d8724-6db3-42c8-b9c3-6c42c1b4d506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:04.664922 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d8724-6db3-42c8-b9c3-6c42c1b4d506 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:04.665474 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d8724-6db3-42c8-b9c3-6c42c1b4d506 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:04.665834 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d8724-6db3-42c8-b9c3-6c42c1b4d506 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:04.680180 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d8724-6db3-42c8-b9c3-6c42c1b4d506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:04.688054 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b2f09-0d64-4146-b1ad-46b5bd92bd76 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:04.690116 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-3f5d8724-6db3-42c8-b9c3-6c42c1b4d506 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:14:04.690116 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:04.690116 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:04.690116 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:04.690116 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:04.690116 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:04.690116 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:04.690116 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:04.690116 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:04.690116 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:04.690116 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:04.690116 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:04.690116 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:04.690116 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:04.690116 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:04.690116 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:04.691219 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:04.691219 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:04.691219 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:04.691219 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:04.691219 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:04.691219 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:04.691219 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:04.691219 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:04.691219 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:04.691219 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:04.691219 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:04.691219 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:04.691219 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:04.691219 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:04.691219 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:04.691219 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:04.692165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:04.692165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:04.692165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:04.692165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:04.692165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:04.692165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:04.692165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:04.692165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:04.692165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:04.692165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:04.692165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:14:04.692165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:04.693146 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 170/346] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:14:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:04.694277 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d8724-6db3-42c8-b9c3-6c42c1b4d506 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:04.729014 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492a2ff-63e6-47e4-a32a-612f74fd5f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:04.729945 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492a2ff-63e6-47e4-a32a-612f74fd5f42 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:04.730230 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492a2ff-63e6-47e4-a32a-612f74fd5f42 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:04.730501 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492a2ff-63e6-47e4-a32a-612f74fd5f42 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:04.742231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492a2ff-63e6-47e4-a32a-612f74fd5f42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:04.750855 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-a492a2ff-63e6-47e4-a32a-612f74fd5f42 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 17:14:04.750855 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:04.750855 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:04.750855 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:04.750855 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:04.750855 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:04.750855 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:04.750855 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:04.750855 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:04.750855 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:04.750855 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:04.750855 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:04.750855 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:04.750855 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:04.750855 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:04.750855 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:04.751812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:04.751812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:04.751812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:04.751812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:04.751812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:04.751812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:04.751812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:04.751812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:04.751812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:04.751812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:04.751812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:04.751812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:04.751812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:04.751812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:04.751812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:04.751812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:04.752633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:04.752633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:04.752633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:04.752633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:04.752633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:04.752633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:04.752633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:04.752633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:04.752633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:04.752633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:04.752633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 17:14:04.752633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:04.752633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 177/347] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:14:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:04.753335 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492a2ff-63e6-47e4-a32a-612f74fd5f42 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:04.808298 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d8724-6db3-42c8-b9c3-6c42c1b4d506 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:04.850592 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5331978-fdf9-49c0-b34d-c3d72e597be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:04.851256 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5331978-fdf9-49c0-b34d-c3d72e597be9 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:04.851526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5331978-fdf9-49c0-b34d-c3d72e597be9 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:04.851788 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5331978-fdf9-49c0-b34d-c3d72e597be9 None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:04.852879 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5331978-fdf9-49c0-b34d-c3d72e597be9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:04.853179 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5331978-fdf9-49c0-b34d-c3d72e597be9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:04.854833 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5331978-fdf9-49c0-b34d-c3d72e597be9 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:04.867647 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492a2ff-63e6-47e4-a32a-612f74fd5f42 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:04.869297 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 171/348] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:14:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:04.870303 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5331978-fdf9-49c0-b34d-c3d72e597be9 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:04.891798 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:04.909701 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e07b2-efcb-4677-9bf9-ebe633b2c54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:04.910312 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e07b2-efcb-4677-9bf9-ebe633b2c54c None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:04.910660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e07b2-efcb-4677-9bf9-ebe633b2c54c None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:04.910935 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e07b2-efcb-4677-9bf9-ebe633b2c54c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:04.923002 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:04.984693 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e07b2-efcb-4677-9bf9-ebe633b2c54c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:04.986203 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e07b2-efcb-4677-9bf9-ebe633b2c54c None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:05.014156 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5331978-fdf9-49c0-b34d-c3d72e597be9 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:05.055637 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bf300-446b-4fbb-962d-d147409da905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:05.056837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf300-446b-4fbb-962d-d147409da905 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:05.057114 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf300-446b-4fbb-962d-d147409da905 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:05.057384 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf300-446b-4fbb-962d-d147409da905 None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:05.058444 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bf300-446b-4fbb-962d-d147409da905 None admin] RBAC: Adding query filter params (name=member) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:05.059001 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bf300-446b-4fbb-962d-d147409da905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:05.061026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bf300-446b-4fbb-962d-d147409da905 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:05.073686 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 172/349] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:14:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:05.074688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bf300-446b-4fbb-962d-d147409da905 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:05.114117 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 178/350] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:14:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:14:05.115078 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e07b2-efcb-4677-9bf9-ebe633b2c54c None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:05.142058 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:05.204890 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bf300-446b-4fbb-962d-d147409da905 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:05.209836 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:05.235223 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e07b2-efcb-4677-9bf9-ebe633b2c54c None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:05.251279 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3129f62-e4c2-4ecb-9262-b669856bc4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:05.251951 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3129f62-e4c2-4ecb-9262-b669856bc4b7 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:05.252229 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3129f62-e4c2-4ecb-9262-b669856bc4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:05.252497 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3129f62-e4c2-4ecb-9262-b669856bc4b7 None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:05.253243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3129f62-e4c2-4ecb-9262-b669856bc4b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:05.253542 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3129f62-e4c2-4ecb-9262-b669856bc4b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:05.255083 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3129f62-e4c2-4ecb-9262-b669856bc4b7 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:05.266096 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 173/351] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:14:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:05.267308 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3129f62-e4c2-4ecb-9262-b669856bc4b7 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:05.281659 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722e359-b1b8-481e-8b57-5c25bb04fb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:05.282304 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722e359-b1b8-481e-8b57-5c25bb04fb7e None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:05.282639 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722e359-b1b8-481e-8b57-5c25bb04fb7e None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:05.282895 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722e359-b1b8-481e-8b57-5c25bb04fb7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:05.367238 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722e359-b1b8-481e-8b57-5c25bb04fb7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:05.369174 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722e359-b1b8-481e-8b57-5c25bb04fb7e None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:05.395313 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:05.401667 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3129f62-e4c2-4ecb-9262-b669856bc4b7 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:05.458103 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2949c-edd8-4e28-9408-9ac4a97b71ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:05.458744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2949c-edd8-4e28-9408-9ac4a97b71ff None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:05.459027 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2949c-edd8-4e28-9408-9ac4a97b71ff None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:05.459293 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2949c-edd8-4e28-9408-9ac4a97b71ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:05.501342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 179/352] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:14:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:14:05.504730 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a082e3-df4d-406e-893d-0a5145a54383 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:05.504730 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a082e3-df4d-406e-893d-0a5145a54383 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:05.504730 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a082e3-df4d-406e-893d-0a5145a54383 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:05.505013 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 180/353] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:05.505702 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a082e3-df4d-406e-893d-0a5145a54383 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:05.510832 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:05.556458 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2949c-edd8-4e28-9408-9ac4a97b71ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:05.558315 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2949c-edd8-4e28-9408-9ac4a97b71ff None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:05.651024 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a082e3-df4d-406e-893d-0a5145a54383 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:05.680594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:05.690085 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 174/354] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:14:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:14:05.690812 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2949c-edd8-4e28-9408-9ac4a97b71ff None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:05.698868 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2285dea-52d4-4908-889c-d2a9919f1983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:05.699744 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2285dea-52d4-4908-889c-d2a9919f1983 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:05.700023 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2285dea-52d4-4908-889c-d2a9919f1983 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:05.700294 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2285dea-52d4-4908-889c-d2a9919f1983 None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:05.701480 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2285dea-52d4-4908-889c-d2a9919f1983 None admin] RBAC: Authorizing `identity:get_project(project_id=20fbbdffa9b84d99b150f2395751706c)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:05.702961 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2285dea-52d4-4908-889c-d2a9919f1983 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:05.704653 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 181/355] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:14:05 2022] GET /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:05.705413 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2285dea-52d4-4908-889c-d2a9919f1983 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:05.768302 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:05.812075 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2949c-edd8-4e28-9408-9ac4a97b71ff None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:05.829111 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2285dea-52d4-4908-889c-d2a9919f1983 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:05.852395 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513de215-444e-44c6-885a-37a2420fcab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:05.852395 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513de215-444e-44c6-885a-37a2420fcab1 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:05.852395 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513de215-444e-44c6-885a-37a2420fcab1 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:05.852395 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513de215-444e-44c6-885a-37a2420fcab1 None admin] PATH_INFO: `/v3/users/69689b171e6b4c048c6071c1aa4783bc` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:05.854780 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513de215-444e-44c6-885a-37a2420fcab1 None admin] RBAC: Authorizing `identity:get_user(user_id=69689b171e6b4c048c6071c1aa4783bc)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:05.856341 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513de215-444e-44c6-885a-37a2420fcab1 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:05.858004 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 175/356] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 24 17:14:05 2022] GET /identity/v3/users/69689b171e6b4c048c6071c1aa4783bc => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:05.859342 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c980023-790d-4e9a-ace0-39c4346b6bfa None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:05.859624 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c980023-790d-4e9a-ace0-39c4346b6bfa None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:05.859897 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c980023-790d-4e9a-ace0-39c4346b6bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:05.872804 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcb6d5-4e37-49e1-8fd1-28b5048c0e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:05.873661 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcb6d5-4e37-49e1-8fd1-28b5048c0e19 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:05.873952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcb6d5-4e37-49e1-8fd1-28b5048c0e19 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:05.874219 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcb6d5-4e37-49e1-8fd1-28b5048c0e19 None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:05.875493 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcb6d5-4e37-49e1-8fd1-28b5048c0e19 None admin] RBAC: Authorizing `identity:get_project(project_id=08f7023404fc4480a32378a0d7e2f040)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:05.876936 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcb6d5-4e37-49e1-8fd1-28b5048c0e19 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:05.878641 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 182/357] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:14:05 2022] GET /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:05.879944 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a284e-5440-47e4-a88e-c5fd792714ce None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:05.880225 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a284e-5440-47e4-a88e-c5fd792714ce None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:05.880494 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a284e-5440-47e4-a88e-c5fd792714ce None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:05.881295 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-6c980023-790d-4e9a-ace0-39c4346b6bfa None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:05.881803 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 183/358] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:05.882464 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-6c980023-790d-4e9a-ace0-39c4346b6bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:05.886882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a284e-5440-47e4-a88e-c5fd792714ce None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:05.958192 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:05.962558 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 176/359] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:05.963576 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c980023-790d-4e9a-ace0-39c4346b6bfa None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:06.011883 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a284e-5440-47e4-a88e-c5fd792714ce None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:06.049549 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:06.062058 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388ebb8-41ee-4e80-bc5c-859490aa4a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:06.062956 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388ebb8-41ee-4e80-bc5c-859490aa4a2c None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:06.063237 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388ebb8-41ee-4e80-bc5c-859490aa4a2c None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:06.064201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388ebb8-41ee-4e80-bc5c-859490aa4a2c None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:06.064720 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388ebb8-41ee-4e80-bc5c-859490aa4a2c None admin] RBAC: Authorizing `identity:get_project(project_id=20fbbdffa9b84d99b150f2395751706c)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:06.066181 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388ebb8-41ee-4e80-bc5c-859490aa4a2c None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:06.067917 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 184/360] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:14:05 2022] GET /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:06.068694 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388ebb8-41ee-4e80-bc5c-859490aa4a2c None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:06.095860 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c980023-790d-4e9a-ace0-39c4346b6bfa None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:06.139898 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a701be-48ab-475a-9f50-0bd81a8a7627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:06.141182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a701be-48ab-475a-9f50-0bd81a8a7627 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:06.141461 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a701be-48ab-475a-9f50-0bd81a8a7627 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:06.141732 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a701be-48ab-475a-9f50-0bd81a8a7627 None admin] PATH_INFO: `/v3/groups/1c85486e99b74c88b2aff14d748ff4ea` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:06.148658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a701be-48ab-475a-9f50-0bd81a8a7627 None admin] RBAC: Authorizing `identity:get_group(group_id=1c85486e99b74c88b2aff14d748ff4ea)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:06.150310 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a701be-48ab-475a-9f50-0bd81a8a7627 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:06.152291 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 177/361] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 24 17:14:05 2022] GET /identity/v3/groups/1c85486e99b74c88b2aff14d748ff4ea => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:06.152946 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a701be-48ab-475a-9f50-0bd81a8a7627 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:06.197981 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388ebb8-41ee-4e80-bc5c-859490aa4a2c None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:06.232345 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:06.243578 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ffb1b-042d-42e2-a026-959bf30144db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:06.244232 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ffb1b-042d-42e2-a026-959bf30144db None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:06.244514 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ffb1b-042d-42e2-a026-959bf30144db None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:06.244786 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ffb1b-042d-42e2-a026-959bf30144db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:06.245620 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ffb1b-042d-42e2-a026-959bf30144db None admin] RBAC: Adding query filter params (role.id=b0d58ae775d64617af2ab8d0f0952ea6, user.id=69689b171e6b4c048c6071c1aa4783bc, scope.system=all) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:06.245929 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ffb1b-042d-42e2-a026-959bf30144db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:06.247456 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ffb1b-042d-42e2-a026-959bf30144db None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:06.265255 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 185/362] 10.222.0.15 () {56 vars in 1308 bytes} [Fri Jun 24 17:14:06 2022] GET /identity/v3/role_assignments?user.id=69689b171e6b4c048c6071c1aa4783bc&scope.system=all&role.id=b0d58ae775d64617af2ab8d0f0952ea6 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:06.265255 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431891f-d17a-4822-b08c-2b9b6ef5bb6c None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:06.265255 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431891f-d17a-4822-b08c-2b9b6ef5bb6c None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:06.265255 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431891f-d17a-4822-b08c-2b9b6ef5bb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:06.276993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a701be-48ab-475a-9f50-0bd81a8a7627 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:06.286609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-a431891f-d17a-4822-b08c-2b9b6ef5bb6c None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:06.286609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-a431891f-d17a-4822-b08c-2b9b6ef5bb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:06.311277 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:06.320514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f4130-0223-4af4-a19a-935d42c69324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:06.321438 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f4130-0223-4af4-a19a-935d42c69324 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:06.321714 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f4130-0223-4af4-a19a-935d42c69324 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:06.321988 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f4130-0223-4af4-a19a-935d42c69324 None admin] PATH_INFO: `/v3/groups/1c85486e99b74c88b2aff14d748ff4ea` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:06.324938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f4130-0223-4af4-a19a-935d42c69324 None admin] RBAC: Authorizing `identity:get_group(group_id=1c85486e99b74c88b2aff14d748ff4ea)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:06.325821 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f4130-0223-4af4-a19a-935d42c69324 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:06.328477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 178/363] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 24 17:14:06 2022] GET /identity/v3/groups/1c85486e99b74c88b2aff14d748ff4ea => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:06.328743 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f4130-0223-4af4-a19a-935d42c69324 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:06.402354 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 186/364] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:06.405223 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431891f-d17a-4822-b08c-2b9b6ef5bb6c None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:06.478139 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f4130-0223-4af4-a19a-935d42c69324 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:06.522430 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed53be9-defb-42aa-b5f5-53e9e80f8e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:06.523329 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed53be9-defb-42aa-b5f5-53e9e80f8e2a None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:06.523612 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed53be9-defb-42aa-b5f5-53e9e80f8e2a None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:06.523869 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed53be9-defb-42aa-b5f5-53e9e80f8e2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:06.536726 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed53be9-defb-42aa-b5f5-53e9e80f8e2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:06.537458 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431891f-d17a-4822-b08c-2b9b6ef5bb6c None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:06.544948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-9ed53be9-defb-42aa-b5f5-53e9e80f8e2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:14:06.544948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:06.544948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:06.544948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:06.544948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:06.544948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:06.544948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:06.544948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:06.544948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:06.544948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:06.544948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:06.544948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:06.544948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:06.544948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:06.544948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:06.544948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:06.545871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:06.545871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:06.545871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:06.545871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:06.545871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:06.545871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:06.545871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:06.545871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:06.545871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:06.545871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:06.545871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:06.545871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:06.545871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:06.545871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:06.545871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:06.545871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:06.546832 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:06.546832 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:06.546832 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:06.546832 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:06.546832 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:06.546832 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:06.546832 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:06.546832 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:06.546832 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:06.546832 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:06.546832 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:14:06.546832 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:06.546832 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 179/365] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 24 17:14:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:06.547551 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed53be9-defb-42aa-b5f5-53e9e80f8e2a None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:06.556603 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:06.578946 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a82ba0-c3c4-4899-9540-06a23cd9153a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:06.579941 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a82ba0-c3c4-4899-9540-06a23cd9153a None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:06.580992 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a82ba0-c3c4-4899-9540-06a23cd9153a None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:06.580992 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a82ba0-c3c4-4899-9540-06a23cd9153a None admin] PATH_INFO: `/v3/groups/1c85486e99b74c88b2aff14d748ff4ea` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:06.582882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a82ba0-c3c4-4899-9540-06a23cd9153a None admin] RBAC: Authorizing `identity:get_group(group_id=1c85486e99b74c88b2aff14d748ff4ea)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:06.584682 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a82ba0-c3c4-4899-9540-06a23cd9153a None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:06.586338 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 187/366] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 24 17:14:06 2022] GET /identity/v3/groups/1c85486e99b74c88b2aff14d748ff4ea => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:06.587218 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a82ba0-c3c4-4899-9540-06a23cd9153a None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:06.619552 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:06.677289 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed53be9-defb-42aa-b5f5-53e9e80f8e2a None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:06.704652 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a82ba0-c3c4-4899-9540-06a23cd9153a None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:06.723145 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4199f4-a07e-488e-848b-da91c5358c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:06.723841 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4199f4-a07e-488e-848b-da91c5358c14 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:06.724123 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4199f4-a07e-488e-848b-da91c5358c14 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:06.724405 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4199f4-a07e-488e-848b-da91c5358c14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:06.725247 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4199f4-a07e-488e-848b-da91c5358c14 None admin] RBAC: Adding query filter params (group.id=1c85486e99b74c88b2aff14d748ff4ea, role.id=bbc0c8e77a594880a35aae1d21773668, scope.project.id=20fbbdffa9b84d99b150f2395751706c) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:06.725559 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4199f4-a07e-488e-848b-da91c5358c14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:06.727764 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4199f4-a07e-488e-848b-da91c5358c14 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:06.735168 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 180/367] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Jun 24 17:14:06 2022] GET /identity/v3/role_assignments?group.id=1c85486e99b74c88b2aff14d748ff4ea&scope.project.id=20fbbdffa9b84d99b150f2395751706c&role.id=bbc0c8e77a594880a35aae1d21773668 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:06.736012 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4199f4-a07e-488e-848b-da91c5358c14 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:06.755341 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b5b99-5ef8-48b4-b9ae-199e5375a730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:06.756719 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b5b99-5ef8-48b4-b9ae-199e5375a730 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:06.757515 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b5b99-5ef8-48b4-b9ae-199e5375a730 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:06.757808 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b5b99-5ef8-48b4-b9ae-199e5375a730 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:06.758780 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b5b99-5ef8-48b4-b9ae-199e5375a730 None admin] RBAC: Adding query filter params (group.id=1c85486e99b74c88b2aff14d748ff4ea, role.id=ee8d50c25f9347d5b99d4a346f7c2fa8, scope.project.id=08f7023404fc4480a32378a0d7e2f040) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:06.759147 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b5b99-5ef8-48b4-b9ae-199e5375a730 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:06.760682 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b5b99-5ef8-48b4-b9ae-199e5375a730 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:06.767622 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 188/368] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Jun 24 17:14:06 2022] GET /identity/v3/role_assignments?group.id=1c85486e99b74c88b2aff14d748ff4ea&scope.project.id=08f7023404fc4480a32378a0d7e2f040&role.id=ee8d50c25f9347d5b99d4a346f7c2fa8 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:06.768654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b5b99-5ef8-48b4-b9ae-199e5375a730 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:06.837033 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:06.904366 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4199f4-a07e-488e-848b-da91c5358c14 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:06.914998 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b5b99-5ef8-48b4-b9ae-199e5375a730 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:06.929344 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:06.960409 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e4fb6-a0b6-4fe4-bb88-4ec6e5f66265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:06.961288 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e4fb6-a0b6-4fe4-bb88-4ec6e5f66265 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:06.961645 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e4fb6-a0b6-4fe4-bb88-4ec6e5f66265 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:06.961943 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e4fb6-a0b6-4fe4-bb88-4ec6e5f66265 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:06.976343 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2f37c-0cd4-452a-b796-3d7d374ab5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:06.978654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2f37c-0cd4-452a-b796-3d7d374ab5ee None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:06.978654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2f37c-0cd4-452a-b796-3d7d374ab5ee None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:06.978862 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2f37c-0cd4-452a-b796-3d7d374ab5ee None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:06.979606 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2f37c-0cd4-452a-b796-3d7d374ab5ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:06.979912 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2f37c-0cd4-452a-b796-3d7d374ab5ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:06.981854 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2f37c-0cd4-452a-b796-3d7d374ab5ee None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:06.982502 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e4fb6-a0b6-4fe4-bb88-4ec6e5f66265 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:06.991786 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 189/369] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:06.992525 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2f37c-0cd4-452a-b796-3d7d374ab5ee None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:06.993069 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-5e6e4fb6-a0b6-4fe4-bb88-4ec6e5f66265 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:14:06.993069 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:06.993069 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:06.993069 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:06.993069 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:06.993069 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:06.993069 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:06.993069 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:06.993069 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:06.993069 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:06.993069 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:06.993069 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:06.993069 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:06.993069 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:06.993069 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:06.993069 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:06.994110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:06.994110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:06.994110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:06.994110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:06.994110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:06.994110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:06.994110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:06.994110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:06.994110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:06.994110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:06.994110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:06.994110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:06.994110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:06.994110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:06.994110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:06.994110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:06.995048 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:06.995048 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:06.995048 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:06.995048 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:06.995048 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:06.995048 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:06.995048 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:06.995048 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:06.995048 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:06.995048 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:06.995048 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:14:06.995048 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:06.997136 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 181/370] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 24 17:14:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:06.998112 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e4fb6-a0b6-4fe4-bb88-4ec6e5f66265 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:07.130392 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2f37c-0cd4-452a-b796-3d7d374ab5ee None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:07.144116 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:07.145010 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e4fb6-a0b6-4fe4-bb88-4ec6e5f66265 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:07.174703 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a4432-6772-424c-82b5-845987bc148e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:07.175589 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a4432-6772-424c-82b5-845987bc148e None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:07.175725 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a4432-6772-424c-82b5-845987bc148e None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:07.175987 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a4432-6772-424c-82b5-845987bc148e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:07.176845 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a4432-6772-424c-82b5-845987bc148e None admin] RBAC: Adding query filter params (group.id=1c85486e99b74c88b2aff14d748ff4ea, role.id=ee8d50c25f9347d5b99d4a346f7c2fa8, scope.project.id=20fbbdffa9b84d99b150f2395751706c) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:07.177160 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a4432-6772-424c-82b5-845987bc148e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:07.178735 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a4432-6772-424c-82b5-845987bc148e None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:07.191644 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 190/371] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Jun 24 17:14:06 2022] GET /identity/v3/role_assignments?group.id=1c85486e99b74c88b2aff14d748ff4ea&scope.project.id=20fbbdffa9b84d99b150f2395751706c&role.id=ee8d50c25f9347d5b99d4a346f7c2fa8 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:07.191644 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a4432-6772-424c-82b5-845987bc148e None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:07.207277 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd7ba0-a4db-42c1-a026-635e75a5ab01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:07.207957 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd7ba0-a4db-42c1-a026-635e75a5ab01 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:07.208301 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd7ba0-a4db-42c1-a026-635e75a5ab01 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:07.208575 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd7ba0-a4db-42c1-a026-635e75a5ab01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:07.313386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:07.344601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd7ba0-a4db-42c1-a026-635e75a5ab01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:07.347309 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd7ba0-a4db-42c1-a026-635e75a5ab01 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:07.408841 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a4432-6772-424c-82b5-845987bc148e None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:07.444777 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef78264-e7a9-4629-bd8d-f0c8b9077ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:07.445479 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef78264-e7a9-4629-bd8d-f0c8b9077ad3 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:07.445758 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef78264-e7a9-4629-bd8d-f0c8b9077ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:07.446097 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef78264-e7a9-4629-bd8d-f0c8b9077ad3 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:07.446892 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef78264-e7a9-4629-bd8d-f0c8b9077ad3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:07.447196 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef78264-e7a9-4629-bd8d-f0c8b9077ad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:07.448634 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef78264-e7a9-4629-bd8d-f0c8b9077ad3 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:07.458018 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 191/372] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:14:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:07.463954 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef78264-e7a9-4629-bd8d-f0c8b9077ad3 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:07.471726 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 182/373] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:14:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:14:07.478245 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd7ba0-a4db-42c1-a026-635e75a5ab01 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:07.503102 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:07.571009 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef78264-e7a9-4629-bd8d-f0c8b9077ad3 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:07.606297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883e84a-331e-4e96-8b28-88dd5eed2737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:07.607005 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e84a-331e-4e96-8b28-88dd5eed2737 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:07.607290 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e84a-331e-4e96-8b28-88dd5eed2737 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:07.607570 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e84a-331e-4e96-8b28-88dd5eed2737 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:07.614974 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:07.645175 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd7ba0-a4db-42c1-a026-635e75a5ab01 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:07.678933 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883e84a-331e-4e96-8b28-88dd5eed2737 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:07.680613 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883e84a-331e-4e96-8b28-88dd5eed2737 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:07.715065 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:07.731363 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdb20b-d47f-49b8-8108-acba78360f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:07.732302 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdb20b-d47f-49b8-8108-acba78360f3f None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:07.732590 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdb20b-d47f-49b8-8108-acba78360f3f None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:07.732925 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdb20b-d47f-49b8-8108-acba78360f3f None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:07.739432 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdb20b-d47f-49b8-8108-acba78360f3f None admin] RBAC: Authorizing `identity:get_project(project_id=08f7023404fc4480a32378a0d7e2f040)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:07.740945 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdb20b-d47f-49b8-8108-acba78360f3f None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:07.743274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 183/374] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:14:07 2022] GET /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:07.749515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdb20b-d47f-49b8-8108-acba78360f3f None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:07.782595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 192/375] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:14:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:14:07.788385 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883e84a-331e-4e96-8b28-88dd5eed2737 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:07.895073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883e84a-331e-4e96-8b28-88dd5eed2737 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:07.929234 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5420756-597e-4fef-ba1a-4adcf126865f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:07.930402 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5420756-597e-4fef-ba1a-4adcf126865f None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:07.930823 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5420756-597e-4fef-ba1a-4adcf126865f None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:07.931220 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5420756-597e-4fef-ba1a-4adcf126865f None admin] PATH_INFO: `/v3/projects/df2ee206730346a086b9b4fdd7759036` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:07.932625 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5420756-597e-4fef-ba1a-4adcf126865f None admin] RBAC: Authorizing `identity:get_project(project_id=df2ee206730346a086b9b4fdd7759036)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:07.934193 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5420756-597e-4fef-ba1a-4adcf126865f None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:07.936078 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 193/376] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:14:07 2022] GET /identity/v3/projects/df2ee206730346a086b9b4fdd7759036 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:07.941728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5420756-597e-4fef-ba1a-4adcf126865f None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:07.954932 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:07.996592 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdb20b-d47f-49b8-8108-acba78360f3f None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:08.056136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5420756-597e-4fef-ba1a-4adcf126865f None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:08.101366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0e96e-7754-4a17-bf90-52da170b5ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:08.103642 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0e96e-7754-4a17-bf90-52da170b5ea1 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:08.103994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0e96e-7754-4a17-bf90-52da170b5ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:08.104279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0e96e-7754-4a17-bf90-52da170b5ea1 None admin] PATH_INFO: `/v3/groups/912d05b2eda04f1c9b8466e8369dc612` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:08.111210 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0e96e-7754-4a17-bf90-52da170b5ea1 None admin] RBAC: Authorizing `identity:get_group(group_id=912d05b2eda04f1c9b8466e8369dc612)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:08.113200 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0e96e-7754-4a17-bf90-52da170b5ea1 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:08.115312 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 194/377] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 24 17:14:07 2022] GET /identity/v3/groups/912d05b2eda04f1c9b8466e8369dc612 => generated 229 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:08.122268 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0e96e-7754-4a17-bf90-52da170b5ea1 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:08.132362 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7b817-9cbc-456d-93b0-5374287fee6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:08.133257 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7b817-9cbc-456d-93b0-5374287fee6b None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:08.133598 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7b817-9cbc-456d-93b0-5374287fee6b None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:08.134070 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7b817-9cbc-456d-93b0-5374287fee6b None admin] PATH_INFO: `/v3/groups/1c85486e99b74c88b2aff14d748ff4ea` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:08.135649 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7b817-9cbc-456d-93b0-5374287fee6b None admin] RBAC: Authorizing `identity:get_group(group_id=1c85486e99b74c88b2aff14d748ff4ea)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:08.137168 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7b817-9cbc-456d-93b0-5374287fee6b None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:08.147472 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 184/378] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 24 17:14:07 2022] GET /identity/v3/groups/1c85486e99b74c88b2aff14d748ff4ea => generated 226 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:08.153971 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7b817-9cbc-456d-93b0-5374287fee6b None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:08.205302 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:08.216192 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:08.259982 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0e96e-7754-4a17-bf90-52da170b5ea1 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:08.318632 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d713c-735b-4f24-a927-a0642c6d6d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:08.323604 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d713c-735b-4f24-a927-a0642c6d6d3b None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:08.323888 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d713c-735b-4f24-a927-a0642c6d6d3b None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:08.324162 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d713c-735b-4f24-a927-a0642c6d6d3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:08.325039 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d713c-735b-4f24-a927-a0642c6d6d3b None admin] RBAC: Adding query filter params (group.id=912d05b2eda04f1c9b8466e8369dc612, role.id=ae295b7c396a4e559ecd6d574f097d4a, scope.project.id=df2ee206730346a086b9b4fdd7759036) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:08.325349 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d713c-735b-4f24-a927-a0642c6d6d3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:08.326864 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d713c-735b-4f24-a927-a0642c6d6d3b None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:08.340221 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 195/379] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Jun 24 17:14:08 2022] GET /identity/v3/role_assignments?group.id=912d05b2eda04f1c9b8466e8369dc612&scope.project.id=df2ee206730346a086b9b4fdd7759036&role.id=ae295b7c396a4e559ecd6d574f097d4a => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:08.360771 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7b817-9cbc-456d-93b0-5374287fee6b None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:08.426467 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb68a5-4950-4707-a95f-4ce811516e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:08.427189 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb68a5-4950-4707-a95f-4ce811516e37 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:08.427467 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb68a5-4950-4707-a95f-4ce811516e37 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:08.427740 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb68a5-4950-4707-a95f-4ce811516e37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:08.428614 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb68a5-4950-4707-a95f-4ce811516e37 None admin] RBAC: Adding query filter params (group.id=1c85486e99b74c88b2aff14d748ff4ea, role.id=bbc0c8e77a594880a35aae1d21773668, scope.project.id=08f7023404fc4480a32378a0d7e2f040) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:08.428922 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb68a5-4950-4707-a95f-4ce811516e37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:08.430748 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb68a5-4950-4707-a95f-4ce811516e37 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:08.438052 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 185/380] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Jun 24 17:14:08 2022] GET /identity/v3/role_assignments?group.id=1c85486e99b74c88b2aff14d748ff4ea&scope.project.id=08f7023404fc4480a32378a0d7e2f040&role.id=bbc0c8e77a594880a35aae1d21773668 => generated 260 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:09.301744 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdc3c3-43c7-4358-9425-3cffd254a7e4 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:09.302249 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdc3c3-43c7-4358-9425-3cffd254a7e4 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:09.302249 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdc3c3-43c7-4358-9425-3cffd254a7e4 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:09.303899 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 196/381] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:09.309273 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f6143-00ef-4d5e-a03b-2dbc8dbc87e1 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:09.309685 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f6143-00ef-4d5e-a03b-2dbc8dbc87e1 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:09.309870 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f6143-00ef-4d5e-a03b-2dbc8dbc87e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:09.327615 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-5b3f6143-00ef-4d5e-a03b-2dbc8dbc87e1 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:09.329153 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-5b3f6143-00ef-4d5e-a03b-2dbc8dbc87e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:09.403852 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 186/382] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:09.435314 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdc3c3-43c7-4358-9425-3cffd254a7e4 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:09.588360 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdc3c3-43c7-4358-9425-3cffd254a7e4 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:09.617702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dd25a-b276-4558-98e6-15d022f03bfd None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:09.618545 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dd25a-b276-4558-98e6-15d022f03bfd None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:09.619100 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dd25a-b276-4558-98e6-15d022f03bfd None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:09.620724 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 187/383] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 17:14:09.626341 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:09.627837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56226d3d-b5c2-4aed-a04a-e9e4156e7116 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:09.628365 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56226d3d-b5c2-4aed-a04a-e9e4156e7116 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:09.628818 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56226d3d-b5c2-4aed-a04a-e9e4156e7116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:09.641544 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b880e-c1f5-49ef-b814-b1c27361f8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:09.642680 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b880e-c1f5-49ef-b814-b1c27361f8a2 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:09.643679 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b880e-c1f5-49ef-b814-b1c27361f8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:09.644125 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b880e-c1f5-49ef-b814-b1c27361f8a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:09.662952 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-56226d3d-b5c2-4aed-a04a-e9e4156e7116 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:09.666790 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-56226d3d-b5c2-4aed-a04a-e9e4156e7116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:09.668082 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b880e-c1f5-49ef-b814-b1c27361f8a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:09.675974 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-009b880e-c1f5-49ef-b814-b1c27361f8a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:14:09.675974 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:09.675974 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:09.675974 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:09.675974 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:09.675974 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:09.675974 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:09.675974 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:09.675974 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:09.675974 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:09.675974 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:09.675974 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:09.675974 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:09.675974 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:09.675974 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:09.675974 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:09.676867 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:09.676867 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:09.676867 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:09.676867 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:09.676867 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:09.676867 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:09.676867 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:09.676867 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:09.676867 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:09.676867 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:09.676867 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:09.676867 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:09.676867 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:09.676867 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:09.676867 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:09.676867 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:09.677687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:09.677687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:09.677687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:09.677687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:09.677687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:09.677687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:09.677687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:09.677687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:09.677687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:09.677687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:09.677687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:14:09.677687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:09.679838 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:09.680771 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 197/384] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:14:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:09.687621 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b880e-c1f5-49ef-b814-b1c27361f8a2 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:09.800921 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 188/385] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:09.842000 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56226d3d-b5c2-4aed-a04a-e9e4156e7116 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:09.869832 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b880e-c1f5-49ef-b814-b1c27361f8a2 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:09.925302 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6008b3-14c0-4fd0-91cb-fd4fc6d660d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:09.925965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6008b3-14c0-4fd0-91cb-fd4fc6d660d1 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:09.926241 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6008b3-14c0-4fd0-91cb-fd4fc6d660d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:09.926509 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6008b3-14c0-4fd0-91cb-fd4fc6d660d1 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:09.927292 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6008b3-14c0-4fd0-91cb-fd4fc6d660d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:09.927591 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6008b3-14c0-4fd0-91cb-fd4fc6d660d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:09.928955 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6008b3-14c0-4fd0-91cb-fd4fc6d660d1 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:09.951091 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 198/386] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:14:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:09.954856 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6008b3-14c0-4fd0-91cb-fd4fc6d660d1 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:10.030341 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56226d3d-b5c2-4aed-a04a-e9e4156e7116 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:10.064319 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:10.116151 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c11324-8602-46aa-9bde-83b9fe14adad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:10.116910 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c11324-8602-46aa-9bde-83b9fe14adad None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:10.117188 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c11324-8602-46aa-9bde-83b9fe14adad None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:10.117502 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c11324-8602-46aa-9bde-83b9fe14adad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:10.142915 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:10.147345 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6008b3-14c0-4fd0-91cb-fd4fc6d660d1 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:10.159190 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c11324-8602-46aa-9bde-83b9fe14adad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:10.167566 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-69c11324-8602-46aa-9bde-83b9fe14adad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:14:10.167566 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:10.167566 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:10.167566 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:10.167566 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:10.167566 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:10.167566 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:10.167566 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:10.167566 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:10.167566 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:10.167566 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:10.167566 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:10.167566 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:10.167566 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:10.167566 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:10.167566 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:10.168433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:10.168433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:10.168433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:10.168433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:10.168433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:10.168433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:10.168433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:10.168433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:10.168433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:10.168433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:10.168433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:10.168433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:10.168433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:10.168433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:10.168433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:10.168433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:10.169294 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:10.169294 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:10.169294 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:10.169294 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:10.169294 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:10.169294 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:10.169294 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:10.169294 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:10.169294 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:10.169294 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:10.169294 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:14:10.169294 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:10.169294 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 189/387] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 24 17:14:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:14:10.179559 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c11324-8602-46aa-9bde-83b9fe14adad None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:10.193403 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a461e-b0d2-4d66-b997-966c949e7e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:10.194686 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a461e-b0d2-4d66-b997-966c949e7e5c None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:10.195168 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a461e-b0d2-4d66-b997-966c949e7e5c None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:10.195659 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a461e-b0d2-4d66-b997-966c949e7e5c None admin] PATH_INFO: `/v3/groups/1c85486e99b74c88b2aff14d748ff4ea` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:10.197254 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a461e-b0d2-4d66-b997-966c949e7e5c None admin] RBAC: Authorizing `identity:get_group(group_id=1c85486e99b74c88b2aff14d748ff4ea)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:10.198921 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a461e-b0d2-4d66-b997-966c949e7e5c None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:10.201407 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 199/388] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 24 17:14:09 2022] GET /identity/v3/groups/1c85486e99b74c88b2aff14d748ff4ea => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:10.206907 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a461e-b0d2-4d66-b997-966c949e7e5c None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:10.321483 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a461e-b0d2-4d66-b997-966c949e7e5c None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:10.346930 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:10.364863 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d7ee1-a70a-4a9d-8cf4-5b9d10bc9f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:10.365773 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d7ee1-a70a-4a9d-8cf4-5b9d10bc9f0a None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:10.366868 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d7ee1-a70a-4a9d-8cf4-5b9d10bc9f0a None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:10.368919 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d7ee1-a70a-4a9d-8cf4-5b9d10bc9f0a None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:10.371184 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d7ee1-a70a-4a9d-8cf4-5b9d10bc9f0a None admin] RBAC: Authorizing `identity:get_project(project_id=08f7023404fc4480a32378a0d7e2f040)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:10.372921 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d7ee1-a70a-4a9d-8cf4-5b9d10bc9f0a None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:10.374970 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 200/389] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:14:10 2022] GET /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:10.376171 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349b4a5-78f5-496f-9c8c-f5207533b8d8 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:10.376447 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349b4a5-78f5-496f-9c8c-f5207533b8d8 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:10.376715 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349b4a5-78f5-496f-9c8c-f5207533b8d8 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:10.378026 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 201/390] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:10.383755 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35dfc7-8f2a-453c-b410-78a35fbc6d4c None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:10.384044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35dfc7-8f2a-453c-b410-78a35fbc6d4c None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:10.384317 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35dfc7-8f2a-453c-b410-78a35fbc6d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:10.402081 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-1e35dfc7-8f2a-453c-b410-78a35fbc6d4c None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:10.403296 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-1e35dfc7-8f2a-453c-b410-78a35fbc6d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:10.416383 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c11324-8602-46aa-9bde-83b9fe14adad None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:10.454639 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f449994-4ba7-416c-9ffa-c5ade371acd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:10.455907 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f449994-4ba7-416c-9ffa-c5ade371acd8 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:10.456370 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f449994-4ba7-416c-9ffa-c5ade371acd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:10.456822 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f449994-4ba7-416c-9ffa-c5ade371acd8 None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:10.457779 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f449994-4ba7-416c-9ffa-c5ade371acd8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:10.458264 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f449994-4ba7-416c-9ffa-c5ade371acd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:10.459955 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f449994-4ba7-416c-9ffa-c5ade371acd8 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:10.469782 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 190/391] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:10.470950 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f449994-4ba7-416c-9ffa-c5ade371acd8 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:10.482661 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 202/392] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:10.482661 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35dfc7-8f2a-453c-b410-78a35fbc6d4c None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:10.562755 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:10.580713 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35dfc7-8f2a-453c-b410-78a35fbc6d4c None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:10.598678 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:10.608842 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f449994-4ba7-416c-9ffa-c5ade371acd8 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:10.616488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc937cd-d6b4-499a-a338-48dcd390a9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:10.617648 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc937cd-d6b4-499a-a338-48dcd390a9f6 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:10.617648 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc937cd-d6b4-499a-a338-48dcd390a9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:10.617923 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc937cd-d6b4-499a-a338-48dcd390a9f6 None admin] PATH_INFO: `/v3/groups/1c85486e99b74c88b2aff14d748ff4ea` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:10.619123 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc937cd-d6b4-499a-a338-48dcd390a9f6 None admin] RBAC: Authorizing `identity:get_group(group_id=1c85486e99b74c88b2aff14d748ff4ea)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:10.620548 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc937cd-d6b4-499a-a338-48dcd390a9f6 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:10.622428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 203/393] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 24 17:14:10 2022] GET /identity/v3/groups/1c85486e99b74c88b2aff14d748ff4ea => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:10.623125 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc937cd-d6b4-499a-a338-48dcd390a9f6 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:10.648297 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fa620-be71-4c45-abda-b5763ba94c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:10.649601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa620-be71-4c45-abda-b5763ba94c66 None admin] REQUEST_METHOD: `PUT` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:10.650588 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa620-be71-4c45-abda-b5763ba94c66 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:10.651057 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa620-be71-4c45-abda-b5763ba94c66 None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040/groups/1c85486e99b74c88b2aff14d748ff4ea/roles/ee8d50c25f9347d5b99d4a346f7c2fa8` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:10.654191 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fa620-be71-4c45-abda-b5763ba94c66 None admin] RBAC: Authorizing `identity:create_grant(project_id=08f7023404fc4480a32378a0d7e2f040, group_id=1c85486e99b74c88b2aff14d748ff4ea, role_id=ee8d50c25f9347d5b99d4a346f7c2fa8)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:10.657063 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fa620-be71-4c45-abda-b5763ba94c66 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:10.671519 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 191/394] 10.222.0.15 () {58 vars in 1442 bytes} [Fri Jun 24 17:14:10 2022] PUT /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040/groups/1c85486e99b74c88b2aff14d748ff4ea/roles/ee8d50c25f9347d5b99d4a346f7c2fa8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:14:10.680002 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fa620-be71-4c45-abda-b5763ba94c66 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:10.749665 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc937cd-d6b4-499a-a338-48dcd390a9f6 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:10.787689 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881970ea-3550-407f-95fc-e37e6c26ae05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:10.788855 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881970ea-3550-407f-95fc-e37e6c26ae05 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:10.789413 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881970ea-3550-407f-95fc-e37e6c26ae05 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:10.790027 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881970ea-3550-407f-95fc-e37e6c26ae05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:10.803116 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881970ea-3550-407f-95fc-e37e6c26ae05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:10.813236 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-881970ea-3550-407f-95fc-e37e6c26ae05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:14:10.813236 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:10.813236 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:10.813236 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:10.813236 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:10.813236 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:10.813236 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:10.813236 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:10.813236 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:10.813236 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:10.813236 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:10.813236 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:10.813236 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:10.813236 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:10.813236 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:10.813236 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:10.814214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:10.814214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:10.814214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:10.814214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:10.814214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:10.814214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:10.814214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:10.814214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:10.814214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:10.814214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:10.814214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:10.814214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:10.814214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:10.814214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:10.814214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:10.814214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:10.815070 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:10.815070 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:10.815070 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:10.815070 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:10.815070 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:10.815070 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:10.815070 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:10.815070 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:10.815070 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:10.815070 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:10.815070 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:14:10.815070 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:10.817983 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 204/395] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:14:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:10.824955 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881970ea-3550-407f-95fc-e37e6c26ae05 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:10.884257 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:10.895708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fa620-be71-4c45-abda-b5763ba94c66 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:10.947020 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:10.957892 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881970ea-3550-407f-95fc-e37e6c26ae05 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:10.962360 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4ac42-d1eb-44cc-8f13-8f5fb66323d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:10.963248 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4ac42-d1eb-44cc-8f13-8f5fb66323d2 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:10.963587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4ac42-d1eb-44cc-8f13-8f5fb66323d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:10.963865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4ac42-d1eb-44cc-8f13-8f5fb66323d2 None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:10.965110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4ac42-d1eb-44cc-8f13-8f5fb66323d2 None admin] RBAC: Authorizing `identity:get_project(project_id=20fbbdffa9b84d99b150f2395751706c)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:10.966641 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4ac42-d1eb-44cc-8f13-8f5fb66323d2 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:10.968658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 192/396] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:14:10 2022] GET /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:10.969722 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f34d95-35ab-46d2-a894-e098c6c3206e None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:10.974922 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f34d95-35ab-46d2-a894-e098c6c3206e None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:10.975264 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f34d95-35ab-46d2-a894-e098c6c3206e None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:10.977487 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 193/397] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:10.978147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f34d95-35ab-46d2-a894-e098c6c3206e None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:11.010769 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10eaa9-e09a-4956-8aa6-ce68cee3731a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:11.012528 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10eaa9-e09a-4956-8aa6-ce68cee3731a None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:11.013039 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10eaa9-e09a-4956-8aa6-ce68cee3731a None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:11.013738 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10eaa9-e09a-4956-8aa6-ce68cee3731a None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:11.015261 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10eaa9-e09a-4956-8aa6-ce68cee3731a None admin] RBAC: Adding query filter params (name=member) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:11.015923 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10eaa9-e09a-4956-8aa6-ce68cee3731a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:11.017683 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10eaa9-e09a-4956-8aa6-ce68cee3731a None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:11.030129 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 205/398] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:14:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:11.036524 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75b37b-95f7-4698-b7e8-4b30ff32686b None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:11.036524 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75b37b-95f7-4698-b7e8-4b30ff32686b None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:11.036524 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75b37b-95f7-4698-b7e8-4b30ff32686b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:11.054237 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-8c75b37b-95f7-4698-b7e8-4b30ff32686b None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:11.055523 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-8c75b37b-95f7-4698-b7e8-4b30ff32686b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:11.106523 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f34d95-35ab-46d2-a894-e098c6c3206e None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:11.134776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 206/399] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:11.135634 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75b37b-95f7-4698-b7e8-4b30ff32686b None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:11.144708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa594ef1-e426-41a9-b00b-dbcfd073bfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:11.145619 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa594ef1-e426-41a9-b00b-dbcfd073bfeb None admin] REQUEST_METHOD: `PUT` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:11.145895 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa594ef1-e426-41a9-b00b-dbcfd073bfeb None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:11.146162 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa594ef1-e426-41a9-b00b-dbcfd073bfeb None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c/groups/1c85486e99b74c88b2aff14d748ff4ea/roles/bbc0c8e77a594880a35aae1d21773668` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:11.148528 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa594ef1-e426-41a9-b00b-dbcfd073bfeb None admin] RBAC: Authorizing `identity:create_grant(project_id=20fbbdffa9b84d99b150f2395751706c, group_id=1c85486e99b74c88b2aff14d748ff4ea, role_id=bbc0c8e77a594880a35aae1d21773668)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:11.150054 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa594ef1-e426-41a9-b00b-dbcfd073bfeb None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:11.167016 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 194/400] 10.222.0.15 () {58 vars in 1442 bytes} [Fri Jun 24 17:14:10 2022] PUT /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c/groups/1c85486e99b74c88b2aff14d748ff4ea/roles/bbc0c8e77a594880a35aae1d21773668 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:14:11.185899 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa594ef1-e426-41a9-b00b-dbcfd073bfeb None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:11.203456 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:11.263538 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75b37b-95f7-4698-b7e8-4b30ff32686b None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:11.286325 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:11.306388 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6e1d2-7ebc-4cea-bae7-3484a23ca06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:11.307329 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6e1d2-7ebc-4cea-bae7-3484a23ca06a None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:11.307604 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6e1d2-7ebc-4cea-bae7-3484a23ca06a None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:11.307873 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6e1d2-7ebc-4cea-bae7-3484a23ca06a None admin] PATH_INFO: `/v3/groups/1c85486e99b74c88b2aff14d748ff4ea` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:11.312534 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6e1d2-7ebc-4cea-bae7-3484a23ca06a None admin] RBAC: Authorizing `identity:get_group(group_id=1c85486e99b74c88b2aff14d748ff4ea)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:11.314020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6e1d2-7ebc-4cea-bae7-3484a23ca06a None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:11.315989 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 207/401] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 24 17:14:11 2022] GET /identity/v3/groups/1c85486e99b74c88b2aff14d748ff4ea => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:11.321783 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6e1d2-7ebc-4cea-bae7-3484a23ca06a None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:11.383147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa594ef1-e426-41a9-b00b-dbcfd073bfeb None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:11.437087 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a3bdd-f38c-4dd7-8d8a-637edf306576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:11.437900 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a3bdd-f38c-4dd7-8d8a-637edf306576 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:11.438203 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a3bdd-f38c-4dd7-8d8a-637edf306576 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:11.438477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a3bdd-f38c-4dd7-8d8a-637edf306576 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:11.451833 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a3bdd-f38c-4dd7-8d8a-637edf306576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:11.460658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-4f6a3bdd-f38c-4dd7-8d8a-637edf306576 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:14:11.460658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:11.460658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:11.460658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:11.460658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:11.460658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:11.460658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:11.460658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:11.460658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:11.460658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:11.460658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:11.460658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:11.460658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:11.460658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:11.460658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:11.460658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:11.461802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:11.461802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:11.461802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:11.461802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:11.461802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:11.461802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:11.461802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:11.461802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:11.461802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:11.461802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:11.461802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:11.461802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:11.461802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:11.461802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:11.461802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:11.461802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:11.462609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:11.462609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:11.462609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:11.462609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:11.462609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:11.462609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:11.462609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:11.462609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:11.462609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:11.462609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:11.462609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:14:11.462609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:11.467000 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 195/402] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 24 17:14:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:14:11.467000 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4fe6e-d76d-4099-9497-3aa4f7ff3250 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:11.467000 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4fe6e-d76d-4099-9497-3aa4f7ff3250 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:11.467000 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4fe6e-d76d-4099-9497-3aa4f7ff3250 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:11.467000 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 196/403] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:11.470197 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4fe6e-d76d-4099-9497-3aa4f7ff3250 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:11.493930 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6e1d2-7ebc-4cea-bae7-3484a23ca06a None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:11.502317 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:11.536358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2192db5-b03c-4741-9ea0-41daa4610b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:11.537642 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2192db5-b03c-4741-9ea0-41daa4610b96 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:11.537818 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2192db5-b03c-4741-9ea0-41daa4610b96 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:11.538197 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2192db5-b03c-4741-9ea0-41daa4610b96 None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:11.540060 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2192db5-b03c-4741-9ea0-41daa4610b96 None admin] RBAC: Authorizing `identity:get_project(project_id=20fbbdffa9b84d99b150f2395751706c)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:11.541472 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2192db5-b03c-4741-9ea0-41daa4610b96 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:11.543736 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 208/404] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:14:11 2022] GET /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:11.545127 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03978cf7-1776-4be0-bcef-6060f823eaae None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:11.545501 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03978cf7-1776-4be0-bcef-6060f823eaae None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:11.546119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03978cf7-1776-4be0-bcef-6060f823eaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:11.563224 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-03978cf7-1776-4be0-bcef-6060f823eaae None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:11.564530 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-03978cf7-1776-4be0-bcef-6060f823eaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:11.606240 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4fe6e-d76d-4099-9497-3aa4f7ff3250 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:11.619287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:11.644897 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b053b-b3d5-428e-a9a7-3178a4d2fbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:11.645779 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b053b-b3d5-428e-a9a7-3178a4d2fbf0 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:11.646194 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b053b-b3d5-428e-a9a7-3178a4d2fbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:11.646559 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b053b-b3d5-428e-a9a7-3178a4d2fbf0 None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:11.650602 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b053b-b3d5-428e-a9a7-3178a4d2fbf0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:11.650602 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b053b-b3d5-428e-a9a7-3178a4d2fbf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:11.650602 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b053b-b3d5-428e-a9a7-3178a4d2fbf0 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:11.650967 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 209/405] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:11.652086 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03978cf7-1776-4be0-bcef-6060f823eaae None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:11.665099 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 197/406] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:14:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:11.666466 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b053b-b3d5-428e-a9a7-3178a4d2fbf0 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:11.773109 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b053b-b3d5-428e-a9a7-3178a4d2fbf0 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:11.784728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03978cf7-1776-4be0-bcef-6060f823eaae None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:11.787370 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:11.811259 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2348820-518a-40e5-b22d-e556a65a21a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:11.812419 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2348820-518a-40e5-b22d-e556a65a21a6 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:11.812793 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2348820-518a-40e5-b22d-e556a65a21a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:11.813331 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2348820-518a-40e5-b22d-e556a65a21a6 None admin] PATH_INFO: `/v3/groups/912d05b2eda04f1c9b8466e8369dc612` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:11.814732 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2348820-518a-40e5-b22d-e556a65a21a6 None admin] RBAC: Authorizing `identity:get_group(group_id=912d05b2eda04f1c9b8466e8369dc612)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:11.816408 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2348820-518a-40e5-b22d-e556a65a21a6 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:11.822723 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 198/407] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 24 17:14:11 2022] GET /identity/v3/groups/912d05b2eda04f1c9b8466e8369dc612 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:11.824048 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2348820-518a-40e5-b22d-e556a65a21a6 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:11.829022 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b4027-1998-464f-bf05-6eb293c68a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:11.829924 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b4027-1998-464f-bf05-6eb293c68a36 None admin] REQUEST_METHOD: `PUT` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:11.830260 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b4027-1998-464f-bf05-6eb293c68a36 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:11.830538 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b4027-1998-464f-bf05-6eb293c68a36 None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c/groups/1c85486e99b74c88b2aff14d748ff4ea/roles/ee8d50c25f9347d5b99d4a346f7c2fa8` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:11.832691 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b4027-1998-464f-bf05-6eb293c68a36 None admin] RBAC: Authorizing `identity:create_grant(project_id=20fbbdffa9b84d99b150f2395751706c, group_id=1c85486e99b74c88b2aff14d748ff4ea, role_id=ee8d50c25f9347d5b99d4a346f7c2fa8)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:11.834151 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b4027-1998-464f-bf05-6eb293c68a36 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:11.855810 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 210/408] 10.222.0.15 () {58 vars in 1442 bytes} [Fri Jun 24 17:14:11 2022] PUT /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c/groups/1c85486e99b74c88b2aff14d748ff4ea/roles/ee8d50c25f9347d5b99d4a346f7c2fa8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:14:11.856970 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b4027-1998-464f-bf05-6eb293c68a36 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:11.923225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:12.043341 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b4027-1998-464f-bf05-6eb293c68a36 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:12.077803 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2348820-518a-40e5-b22d-e556a65a21a6 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:12.094258 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e17cd7-2458-4557-921c-eea8b9b37e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:12.095447 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e17cd7-2458-4557-921c-eea8b9b37e73 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:12.095853 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e17cd7-2458-4557-921c-eea8b9b37e73 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:12.096343 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e17cd7-2458-4557-921c-eea8b9b37e73 None admin] PATH_INFO: `/v3/projects/df2ee206730346a086b9b4fdd7759036` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:12.099025 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e17cd7-2458-4557-921c-eea8b9b37e73 None admin] RBAC: Authorizing `identity:get_project(project_id=df2ee206730346a086b9b4fdd7759036)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:12.099860 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e17cd7-2458-4557-921c-eea8b9b37e73 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:12.103048 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 211/409] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:14:11 2022] GET /identity/v3/projects/df2ee206730346a086b9b4fdd7759036 => generated 344 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:12.115789 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e17cd7-2458-4557-921c-eea8b9b37e73 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:12.161439 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:12.231348 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845f3a6-6a76-4822-8bec-30574080855b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:12.232184 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845f3a6-6a76-4822-8bec-30574080855b None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:12.232458 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845f3a6-6a76-4822-8bec-30574080855b None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:12.232730 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845f3a6-6a76-4822-8bec-30574080855b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:12.252171 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e17cd7-2458-4557-921c-eea8b9b37e73 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:12.310703 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845f3a6-6a76-4822-8bec-30574080855b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:12.324572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-3845f3a6-6a76-4822-8bec-30574080855b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:14:12.324572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:12.324572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:12.324572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:12.324572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:12.324572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:12.324572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:12.324572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:12.324572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:12.324572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:12.324572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:12.324572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:12.324572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:12.324572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:12.324572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:12.324572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:12.325459 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:12.325459 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:12.325459 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:12.325459 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:12.325459 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:12.325459 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:12.325459 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:12.325459 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:12.325459 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:12.325459 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:12.325459 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:12.325459 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:12.325459 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:12.325459 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:12.325459 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:12.325459 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:12.326241 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:12.326241 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:12.326241 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:12.326241 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:12.326241 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:12.326241 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:12.326241 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:12.326241 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:12.326241 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:12.326241 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:12.326241 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:14:12.326241 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:12.326886 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1187f5-7149-4356-b12f-227ef203fab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:12.327800 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1187f5-7149-4356-b12f-227ef203fab4 None admin] REQUEST_METHOD: `PUT` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:12.327909 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1187f5-7149-4356-b12f-227ef203fab4 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:12.329711 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1187f5-7149-4356-b12f-227ef203fab4 None admin] PATH_INFO: `/v3/projects/df2ee206730346a086b9b4fdd7759036/groups/912d05b2eda04f1c9b8466e8369dc612/roles/ae295b7c396a4e559ecd6d574f097d4a` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:12.329889 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 199/410] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 24 17:14:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 507 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:12.334003 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1187f5-7149-4356-b12f-227ef203fab4 None admin] RBAC: Authorizing `identity:create_grant(project_id=df2ee206730346a086b9b4fdd7759036, group_id=912d05b2eda04f1c9b8466e8369dc612, role_id=ae295b7c396a4e559ecd6d574f097d4a)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:12.336063 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1187f5-7149-4356-b12f-227ef203fab4 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:12.337775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845f3a6-6a76-4822-8bec-30574080855b None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:12.376675 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 212/411] 10.222.0.15 () {58 vars in 1442 bytes} [Fri Jun 24 17:14:12 2022] PUT /identity/v3/projects/df2ee206730346a086b9b4fdd7759036/groups/912d05b2eda04f1c9b8466e8369dc612/roles/ae295b7c396a4e559ecd6d574f097d4a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:14:12.587185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845f3a6-6a76-4822-8bec-30574080855b None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:12.599058 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:12.658381 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0152cb4-8c14-4738-998a-c0974327fcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:12.659104 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0152cb4-8c14-4738-998a-c0974327fcce None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:12.659382 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0152cb4-8c14-4738-998a-c0974327fcce None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:12.659655 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0152cb4-8c14-4738-998a-c0974327fcce None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:12.660415 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0152cb4-8c14-4738-998a-c0974327fcce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:12.660717 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0152cb4-8c14-4738-998a-c0974327fcce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:12.662106 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0152cb4-8c14-4738-998a-c0974327fcce None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:12.671652 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 200/412] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:12.677692 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1187f5-7149-4356-b12f-227ef203fab4 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:12.802558 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:12.813491 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1187f5-7149-4356-b12f-227ef203fab4 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:12.855584 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c06fa7-d5ad-48cc-a05f-68b08de4ab56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:12.856365 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c06fa7-d5ad-48cc-a05f-68b08de4ab56 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:12.856637 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c06fa7-d5ad-48cc-a05f-68b08de4ab56 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:12.856957 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c06fa7-d5ad-48cc-a05f-68b08de4ab56 None admin] PATH_INFO: `/v3/groups/1c85486e99b74c88b2aff14d748ff4ea` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:12.859951 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c06fa7-d5ad-48cc-a05f-68b08de4ab56 None admin] RBAC: Authorizing `identity:get_group(group_id=1c85486e99b74c88b2aff14d748ff4ea)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:12.861412 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c06fa7-d5ad-48cc-a05f-68b08de4ab56 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:12.863505 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 213/413] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 24 17:14:12 2022] GET /identity/v3/groups/1c85486e99b74c88b2aff14d748ff4ea => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:12.869931 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0152cb4-8c14-4738-998a-c0974327fcce None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:12.977626 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0152cb4-8c14-4738-998a-c0974327fcce None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:13.012020 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a6533-e791-47b3-9d49-92206d6fd607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:13.012880 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a6533-e791-47b3-9d49-92206d6fd607 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:13.013157 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a6533-e791-47b3-9d49-92206d6fd607 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:13.013431 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a6533-e791-47b3-9d49-92206d6fd607 None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:13.014731 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a6533-e791-47b3-9d49-92206d6fd607 None admin] RBAC: Authorizing `identity:get_project(project_id=08f7023404fc4480a32378a0d7e2f040)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:13.016185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a6533-e791-47b3-9d49-92206d6fd607 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:13.018243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 201/414] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:14:12 2022] GET /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:13.025157 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c06fa7-d5ad-48cc-a05f-68b08de4ab56 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:13.162392 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c06fa7-d5ad-48cc-a05f-68b08de4ab56 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:13.216266 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18913647-5d9b-42c7-abe6-464326a5ac7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:13.217601 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18913647-5d9b-42c7-abe6-464326a5ac7f None admin] REQUEST_METHOD: `PUT` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:13.218078 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18913647-5d9b-42c7-abe6-464326a5ac7f None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:13.218543 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18913647-5d9b-42c7-abe6-464326a5ac7f None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040/groups/1c85486e99b74c88b2aff14d748ff4ea/roles/bbc0c8e77a594880a35aae1d21773668` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:13.221015 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18913647-5d9b-42c7-abe6-464326a5ac7f None admin] RBAC: Authorizing `identity:create_grant(project_id=08f7023404fc4480a32378a0d7e2f040, group_id=1c85486e99b74c88b2aff14d748ff4ea, role_id=bbc0c8e77a594880a35aae1d21773668)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:13.222744 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18913647-5d9b-42c7-abe6-464326a5ac7f None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:13.245763 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 214/415] 10.222.0.15 () {58 vars in 1442 bytes} [Fri Jun 24 17:14:13 2022] PUT /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040/groups/1c85486e99b74c88b2aff14d748ff4ea/roles/bbc0c8e77a594880a35aae1d21773668 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:14:13.561631 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53226cf1-5e04-453c-a734-37e707f3df5a None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:13.562001 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53226cf1-5e04-453c-a734-37e707f3df5a None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:13.562241 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53226cf1-5e04-453c-a734-37e707f3df5a None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:13.563867 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 202/416] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:13.570503 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27dae3-0313-4c34-af03-a3482db15f3d None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:13.572126 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27dae3-0313-4c34-af03-a3482db15f3d None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:13.572623 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27dae3-0313-4c34-af03-a3482db15f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:13.592066 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-7f27dae3-0313-4c34-af03-a3482db15f3d None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:13.593634 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-7f27dae3-0313-4c34-af03-a3482db15f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:13.614996 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:13.693175 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 215/417] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:13.740010 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53226cf1-5e04-453c-a734-37e707f3df5a None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:13.779373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:13.880496 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53226cf1-5e04-453c-a734-37e707f3df5a None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:13.923279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5096f-9a18-43f4-9893-d086874e8d04 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:13.923630 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5096f-9a18-43f4-9893-d086874e8d04 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:13.923824 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5096f-9a18-43f4-9893-d086874e8d04 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:13.925440 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 216/418] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:13.929817 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf53f0-217f-4c58-a027-77f48d9e5ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:13.930926 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf53f0-217f-4c58-a027-77f48d9e5ac8 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:13.931208 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf53f0-217f-4c58-a027-77f48d9e5ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:13.931481 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf53f0-217f-4c58-a027-77f48d9e5ac8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:13.931995 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be947fb-5bd1-453b-9ca8-2a4e7081b8fb None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:13.932323 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be947fb-5bd1-453b-9ca8-2a4e7081b8fb None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:13.932595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be947fb-5bd1-453b-9ca8-2a4e7081b8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:13.943366 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf53f0-217f-4c58-a027-77f48d9e5ac8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:13.957701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-e5bf53f0-217f-4c58-a027-77f48d9e5ac8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:14:13.957701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:13.957701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:13.957701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:13.957701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:13.957701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:13.957701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:13.957701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:13.957701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:13.957701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:13.957701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:13.957701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:13.957701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:13.957701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:13.957701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:13.957701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:13.958870 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:13.958870 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:13.958870 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:13.958870 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:13.958870 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:13.958870 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:13.958870 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:13.958870 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:13.958870 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:13.958870 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:13.958870 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:13.958870 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:13.958870 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:13.958870 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:13.958870 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:13.958870 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:13.959863 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:13.959863 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:13.959863 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:13.959863 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:13.959863 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:13.959863 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:13.959863 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:13.959863 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:13.959863 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:13.959863 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:13.959863 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:14:13.959863 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:13.962024 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 203/419] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:14:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:13.964913 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-9be947fb-5bd1-453b-9ca8-2a4e7081b8fb None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:13.966251 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-9be947fb-5bd1-453b-9ca8-2a4e7081b8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:13.967899 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf53f0-217f-4c58-a027-77f48d9e5ac8 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:14.107178 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:14.126380 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf53f0-217f-4c58-a027-77f48d9e5ac8 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:14.140777 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 217/420] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:14.164016 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e0b7f-0fed-4f3f-959b-34ac56dbf0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:14.165252 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e0b7f-0fed-4f3f-959b-34ac56dbf0aa None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:14.165533 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e0b7f-0fed-4f3f-959b-34ac56dbf0aa None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:14.165804 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e0b7f-0fed-4f3f-959b-34ac56dbf0aa None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:14.166587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e0b7f-0fed-4f3f-959b-34ac56dbf0aa None admin] RBAC: Adding query filter params (name=member) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:14.166916 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e0b7f-0fed-4f3f-959b-34ac56dbf0aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:14.168349 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e0b7f-0fed-4f3f-959b-34ac56dbf0aa None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:14.180363 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be947fb-5bd1-453b-9ca8-2a4e7081b8fb None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:14.195789 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 204/421] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:14:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:14.202840 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e0b7f-0fed-4f3f-959b-34ac56dbf0aa None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:14.317812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:14.345985 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be947fb-5bd1-453b-9ca8-2a4e7081b8fb None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:14.353873 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e0b7f-0fed-4f3f-959b-34ac56dbf0aa None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:14.391088 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024eabd-413a-4d04-aa4b-ab66ceeec886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:14.391669 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024eabd-413a-4d04-aa4b-ab66ceeec886 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:14.391950 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024eabd-413a-4d04-aa4b-ab66ceeec886 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:14.392232 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024eabd-413a-4d04-aa4b-ab66ceeec886 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:14.418382 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:14.429935 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fe9e0-d408-4b3c-8193-e22a24f5948e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:14.430907 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fe9e0-d408-4b3c-8193-e22a24f5948e None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:14.431193 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fe9e0-d408-4b3c-8193-e22a24f5948e None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:14.431467 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fe9e0-d408-4b3c-8193-e22a24f5948e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:14.467281 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fe9e0-d408-4b3c-8193-e22a24f5948e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:14.470257 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024eabd-413a-4d04-aa4b-ab66ceeec886 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:14.471832 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024eabd-413a-4d04-aa4b-ab66ceeec886 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:14.483743 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-9c3fe9e0-d408-4b3c-8193-e22a24f5948e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:14:14.483743 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:14.483743 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:14.483743 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:14.483743 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:14.483743 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:14.483743 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:14.483743 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:14.483743 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:14.483743 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:14.483743 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:14.483743 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:14.483743 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:14.483743 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:14.483743 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:14.483743 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:14.484748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:14.484748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:14.484748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:14.484748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:14.484748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:14.484748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:14.484748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:14.484748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:14.484748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:14.484748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:14.484748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:14.484748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:14.484748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:14.484748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:14.484748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:14.484748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:14.485577 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:14.485577 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:14.485577 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:14.485577 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:14.485577 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:14.485577 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:14.485577 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:14.485577 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:14.485577 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:14.485577 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:14.485577 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:14:14.485577 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:14.485577 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 218/422] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 24 17:14:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:14.493633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fe9e0-d408-4b3c-8193-e22a24f5948e None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:14.625767 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 205/423] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:14:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:14:14.628702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024eabd-413a-4d04-aa4b-ab66ceeec886 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:14.730965 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:14.738465 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fe9e0-d408-4b3c-8193-e22a24f5948e None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:14.809139 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf8b65-ff05-4548-b7b8-d24d446e2bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:14.809808 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf8b65-ff05-4548-b7b8-d24d446e2bb3 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:14.810085 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf8b65-ff05-4548-b7b8-d24d446e2bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:14.810352 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf8b65-ff05-4548-b7b8-d24d446e2bb3 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:14.811160 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf8b65-ff05-4548-b7b8-d24d446e2bb3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:14.811459 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf8b65-ff05-4548-b7b8-d24d446e2bb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:14.814761 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf8b65-ff05-4548-b7b8-d24d446e2bb3 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:14.828054 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024eabd-413a-4d04-aa4b-ab66ceeec886 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:14.838271 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 219/424] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:14.844252 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf8b65-ff05-4548-b7b8-d24d446e2bb3 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:14.855268 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:14.883627 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b518374-93e1-4afe-9b62-1caaa8020228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:14.884928 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b518374-93e1-4afe-9b62-1caaa8020228 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:14.885203 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b518374-93e1-4afe-9b62-1caaa8020228 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:14.885470 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b518374-93e1-4afe-9b62-1caaa8020228 None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:14.886689 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b518374-93e1-4afe-9b62-1caaa8020228 None admin] RBAC: Authorizing `identity:get_project(project_id=08f7023404fc4480a32378a0d7e2f040)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:14.888135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b518374-93e1-4afe-9b62-1caaa8020228 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:14.890108 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 206/425] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:14:14 2022] GET /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040 => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:14.891322 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b0bba-f658-42df-a201-a3755f5685d0 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:14.891597 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b0bba-f658-42df-a201-a3755f5685d0 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:14.891866 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b0bba-f658-42df-a201-a3755f5685d0 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:14.897084 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 207/426] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:14.897931 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b0bba-f658-42df-a201-a3755f5685d0 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:14.990064 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf8b65-ff05-4548-b7b8-d24d446e2bb3 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:15.030250 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91abdc-fc39-4115-ace8-aeb05482023e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:15.031288 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91abdc-fc39-4115-ace8-aeb05482023e None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:15.031656 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91abdc-fc39-4115-ace8-aeb05482023e None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:15.032018 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91abdc-fc39-4115-ace8-aeb05482023e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:15.032760 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b0bba-f658-42df-a201-a3755f5685d0 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:15.056140 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:15.072882 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee73e7-2dad-412a-90a8-51f532f70e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:15.074016 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee73e7-2dad-412a-90a8-51f532f70e44 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:15.074459 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee73e7-2dad-412a-90a8-51f532f70e44 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:15.075054 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee73e7-2dad-412a-90a8-51f532f70e44 None admin] PATH_INFO: `/v3/groups/1c85486e99b74c88b2aff14d748ff4ea` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:15.076429 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee73e7-2dad-412a-90a8-51f532f70e44 None admin] RBAC: Authorizing `identity:get_group(group_id=1c85486e99b74c88b2aff14d748ff4ea)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:15.078054 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee73e7-2dad-412a-90a8-51f532f70e44 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:15.080215 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 208/427] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 24 17:14:14 2022] GET /identity/v3/groups/1c85486e99b74c88b2aff14d748ff4ea => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:15.081568 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78970cc-35a2-471e-bd41-3a95ea5951d0 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:15.082019 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78970cc-35a2-471e-bd41-3a95ea5951d0 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:15.082484 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78970cc-35a2-471e-bd41-3a95ea5951d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:15.102153 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-d78970cc-35a2-471e-bd41-3a95ea5951d0 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:15.103706 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-d78970cc-35a2-471e-bd41-3a95ea5951d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:15.123609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91abdc-fc39-4115-ace8-aeb05482023e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:15.125198 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91abdc-fc39-4115-ace8-aeb05482023e None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:15.128459 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:15.182593 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 209/428] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:15.182593 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78970cc-35a2-471e-bd41-3a95ea5951d0 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:15.268966 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 220/429] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:14:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 17:14:15.270207 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91abdc-fc39-4115-ace8-aeb05482023e None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:15.300794 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78970cc-35a2-471e-bd41-3a95ea5951d0 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:15.319895 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:15.338926 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccd2e4-edca-4b9a-9db2-26bc7b33a55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:15.339960 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccd2e4-edca-4b9a-9db2-26bc7b33a55c None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:15.340420 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccd2e4-edca-4b9a-9db2-26bc7b33a55c None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:15.340885 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccd2e4-edca-4b9a-9db2-26bc7b33a55c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:15.341902 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccd2e4-edca-4b9a-9db2-26bc7b33a55c None admin] RBAC: Adding query filter params (group.id=1c85486e99b74c88b2aff14d748ff4ea, role.id=ee8d50c25f9347d5b99d4a346f7c2fa8, scope.project.id=08f7023404fc4480a32378a0d7e2f040) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:15.342396 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccd2e4-edca-4b9a-9db2-26bc7b33a55c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:15.344056 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccd2e4-edca-4b9a-9db2-26bc7b33a55c None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:15.350950 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 210/430] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Jun 24 17:14:15 2022] GET /identity/v3/role_assignments?group.id=1c85486e99b74c88b2aff14d748ff4ea&scope.project.id=08f7023404fc4480a32378a0d7e2f040&role.id=ee8d50c25f9347d5b99d4a346f7c2fa8 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:15.355676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccd2e4-edca-4b9a-9db2-26bc7b33a55c None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:15.392749 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91abdc-fc39-4115-ace8-aeb05482023e None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:15.394526 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:15.483391 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a1f04-4e89-47f5-b928-bd34c5e208fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:15.484593 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a1f04-4e89-47f5-b928-bd34c5e208fc None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:15.485085 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a1f04-4e89-47f5-b928-bd34c5e208fc None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:15.485791 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a1f04-4e89-47f5-b928-bd34c5e208fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:15.498319 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a1f04-4e89-47f5-b928-bd34c5e208fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:15.507249 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-d16a1f04-4e89-47f5-b928-bd34c5e208fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:14:15.507249 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:15.507249 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:15.507249 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:15.507249 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:15.507249 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:15.507249 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:15.507249 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:15.507249 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:15.507249 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:15.507249 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:15.507249 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:15.507249 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:15.507249 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:15.507249 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:15.507249 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:15.508573 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:15.508573 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:15.508573 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:15.508573 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:15.508573 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:15.508573 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:15.508573 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:15.508573 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:15.508573 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:15.508573 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:15.508573 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:15.508573 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:15.508573 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:15.508573 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:15.508573 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:15.508573 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:15.509769 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:15.509769 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:15.509769 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:15.509769 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:15.509769 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:15.509769 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:15.509769 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:15.509769 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:15.509769 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:15.509769 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:15.509769 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 17:14:15.509769 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:15.512862 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 221/431] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:14:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:15.514557 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7a3f1-694f-4d4a-ace6-2ea50d04442b None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:15.515173 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7a3f1-694f-4d4a-ace6-2ea50d04442b None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:15.515725 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7a3f1-694f-4d4a-ace6-2ea50d04442b None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:15.517450 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 222/432] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:15.518471 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7a3f1-694f-4d4a-ace6-2ea50d04442b None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:15.521508 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccd2e4-edca-4b9a-9db2-26bc7b33a55c None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:15.558053 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61eeb62-c0d2-42e3-a805-4703fadf57fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:15.558976 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61eeb62-c0d2-42e3-a805-4703fadf57fb None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:15.559255 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61eeb62-c0d2-42e3-a805-4703fadf57fb None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:15.559525 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61eeb62-c0d2-42e3-a805-4703fadf57fb None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:15.560733 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61eeb62-c0d2-42e3-a805-4703fadf57fb None admin] RBAC: Authorizing `identity:get_project(project_id=20fbbdffa9b84d99b150f2395751706c)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:15.562196 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61eeb62-c0d2-42e3-a805-4703fadf57fb None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:15.563960 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 211/433] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:14:15 2022] GET /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:15.565164 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23ebaa-05cd-4a84-95a4-e7818bd85d73 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:15.565441 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23ebaa-05cd-4a84-95a4-e7818bd85d73 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:15.565713 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23ebaa-05cd-4a84-95a4-e7818bd85d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:15.588230 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-9f23ebaa-05cd-4a84-95a4-e7818bd85d73 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:15.589429 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-9f23ebaa-05cd-4a84-95a4-e7818bd85d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:15.644776 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:15.650766 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7a3f1-694f-4d4a-ace6-2ea50d04442b None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:15.678002 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 212/434] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:15.678804 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23ebaa-05cd-4a84-95a4-e7818bd85d73 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:15.697531 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2555348-b36a-480b-bc9d-9d911baa7ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:15.698204 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2555348-b36a-480b-bc9d-9d911baa7ca0 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:15.698481 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2555348-b36a-480b-bc9d-9d911baa7ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:15.698780 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2555348-b36a-480b-bc9d-9d911baa7ca0 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:15.699520 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2555348-b36a-480b-bc9d-9d911baa7ca0 None admin] RBAC: Adding query filter params (name=member) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:15.699854 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2555348-b36a-480b-bc9d-9d911baa7ca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:15.702030 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2555348-b36a-480b-bc9d-9d911baa7ca0 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:15.713091 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 223/435] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:14:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:15.714105 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2555348-b36a-480b-bc9d-9d911baa7ca0 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:15.746739 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:15.793878 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23ebaa-05cd-4a84-95a4-e7818bd85d73 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:15.829193 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9f4c2-fc7e-464f-8cac-23976795b0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:15.830067 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9f4c2-fc7e-464f-8cac-23976795b0d6 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:15.830185 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2555348-b36a-480b-bc9d-9d911baa7ca0 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:15.830345 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9f4c2-fc7e-464f-8cac-23976795b0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:15.830603 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9f4c2-fc7e-464f-8cac-23976795b0d6 None admin] PATH_INFO: `/v3/groups/1c85486e99b74c88b2aff14d748ff4ea` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:15.831787 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9f4c2-fc7e-464f-8cac-23976795b0d6 None admin] RBAC: Authorizing `identity:get_group(group_id=1c85486e99b74c88b2aff14d748ff4ea)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:15.833252 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9f4c2-fc7e-464f-8cac-23976795b0d6 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:15.839838 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 213/436] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 24 17:14:15 2022] GET /identity/v3/groups/1c85486e99b74c88b2aff14d748ff4ea => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:15.839838 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9f4c2-fc7e-464f-8cac-23976795b0d6 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:15.868434 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0abfe-57bb-4db4-ad7c-8a17502618e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:15.869225 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0abfe-57bb-4db4-ad7c-8a17502618e3 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:15.869499 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0abfe-57bb-4db4-ad7c-8a17502618e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:15.869770 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0abfe-57bb-4db4-ad7c-8a17502618e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:15.880914 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0abfe-57bb-4db4-ad7c-8a17502618e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:15.889126 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-04c0abfe-57bb-4db4-ad7c-8a17502618e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:14:15.889126 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:15.889126 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:15.889126 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:15.889126 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:15.889126 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:15.889126 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:15.889126 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:15.889126 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:15.889126 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:15.889126 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:15.889126 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:15.889126 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:15.889126 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:15.889126 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:15.889126 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:15.890014 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:15.890014 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:15.890014 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:15.890014 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:15.890014 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:15.890014 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:15.890014 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:15.890014 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:15.890014 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:15.890014 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:15.890014 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:15.890014 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:15.890014 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:15.890014 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:15.890014 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:15.890014 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:15.891452 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:15.891452 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:15.891452 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:15.891452 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:15.891452 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:15.891452 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:15.891452 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:15.891452 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:15.891452 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:15.891452 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:15.891452 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:14:15.891452 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:15.892113 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:15.892182 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 224/437] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 24 17:14:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:15.894900 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0abfe-57bb-4db4-ad7c-8a17502618e3 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:15.946036 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9f4c2-fc7e-464f-8cac-23976795b0d6 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:15.983665 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5588b-296e-4e5d-be99-1a4d607d80c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:15.984432 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5588b-296e-4e5d-be99-1a4d607d80c2 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:15.984770 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5588b-296e-4e5d-be99-1a4d607d80c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:15.985103 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5588b-296e-4e5d-be99-1a4d607d80c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:15.989269 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:16.005390 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0abfe-57bb-4db4-ad7c-8a17502618e3 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:16.037685 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41b204-d9f4-4d0c-acbd-7dac370ef454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:16.038332 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41b204-d9f4-4d0c-acbd-7dac370ef454 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:16.038636 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41b204-d9f4-4d0c-acbd-7dac370ef454 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:16.038934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41b204-d9f4-4d0c-acbd-7dac370ef454 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:16.039747 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41b204-d9f4-4d0c-acbd-7dac370ef454 None admin] RBAC: Adding query filter params (group.id=1c85486e99b74c88b2aff14d748ff4ea, role.id=bbc0c8e77a594880a35aae1d21773668, scope.project.id=20fbbdffa9b84d99b150f2395751706c) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:16.040059 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41b204-d9f4-4d0c-acbd-7dac370ef454 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:16.041528 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41b204-d9f4-4d0c-acbd-7dac370ef454 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:16.047689 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 225/438] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Jun 24 17:14:15 2022] GET /identity/v3/role_assignments?group.id=1c85486e99b74c88b2aff14d748ff4ea&scope.project.id=20fbbdffa9b84d99b150f2395751706c&role.id=bbc0c8e77a594880a35aae1d21773668 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:16.048396 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41b204-d9f4-4d0c-acbd-7dac370ef454 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:16.065370 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5588b-296e-4e5d-be99-1a4d607d80c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:16.066928 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5588b-296e-4e5d-be99-1a4d607d80c2 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:16.121032 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:16.168959 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41b204-d9f4-4d0c-acbd-7dac370ef454 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:16.183825 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 214/439] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:14:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:14:16.185321 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3925b18-1fc1-4ca9-8d24-40cf560ee73f None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:16.185601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3925b18-1fc1-4ca9-8d24-40cf560ee73f None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:16.185871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3925b18-1fc1-4ca9-8d24-40cf560ee73f None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:16.187368 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 215/440] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:16.189529 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3925b18-1fc1-4ca9-8d24-40cf560ee73f None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:16.218926 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200d344-3f38-4965-a33a-7b9d5721ef95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:16.219873 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200d344-3f38-4965-a33a-7b9d5721ef95 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:16.220149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200d344-3f38-4965-a33a-7b9d5721ef95 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:16.220433 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200d344-3f38-4965-a33a-7b9d5721ef95 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:16.221383 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200d344-3f38-4965-a33a-7b9d5721ef95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:16.221489 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200d344-3f38-4965-a33a-7b9d5721ef95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:16.222863 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200d344-3f38-4965-a33a-7b9d5721ef95 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:16.232708 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 226/441] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:14:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:16.234153 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa452b7-93af-4e3e-ac9b-756cccdd7a6d None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:16.234433 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa452b7-93af-4e3e-ac9b-756cccdd7a6d None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:16.234724 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa452b7-93af-4e3e-ac9b-756cccdd7a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:16.256373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-aaa452b7-93af-4e3e-ac9b-756cccdd7a6d None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:16.257098 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-aaa452b7-93af-4e3e-ac9b-756cccdd7a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:16.262612 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:16.314447 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3925b18-1fc1-4ca9-8d24-40cf560ee73f None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:16.328950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 227/442] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:16.329792 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa452b7-93af-4e3e-ac9b-756cccdd7a6d None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:16.349190 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1476a-e6ae-4eab-b1df-c67723562204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:16.350150 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1476a-e6ae-4eab-b1df-c67723562204 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:16.350494 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1476a-e6ae-4eab-b1df-c67723562204 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:16.350813 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1476a-e6ae-4eab-b1df-c67723562204 None admin] PATH_INFO: `/v3/projects/20fbbdffa9b84d99b150f2395751706c` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:16.353148 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1476a-e6ae-4eab-b1df-c67723562204 None admin] RBAC: Authorizing `identity:get_project(project_id=20fbbdffa9b84d99b150f2395751706c)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:16.354616 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1476a-e6ae-4eab-b1df-c67723562204 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:16.356598 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 216/443] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:14:16 2022] GET /identity/v3/projects/20fbbdffa9b84d99b150f2395751706c => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:16.357367 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1476a-e6ae-4eab-b1df-c67723562204 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:16.375523 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:16.429235 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa452b7-93af-4e3e-ac9b-756cccdd7a6d None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:16.454894 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1476a-e6ae-4eab-b1df-c67723562204 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:16.462629 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989d881-818d-4611-8636-6336898ea467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:16.463275 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989d881-818d-4611-8636-6336898ea467 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:16.463547 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989d881-818d-4611-8636-6336898ea467 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:16.463814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989d881-818d-4611-8636-6336898ea467 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:16.474196 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:16.488968 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49eafb6-f13f-4b12-b98b-35b7e8444f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:16.489773 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49eafb6-f13f-4b12-b98b-35b7e8444f4d None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:16.490049 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49eafb6-f13f-4b12-b98b-35b7e8444f4d None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:16.490314 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49eafb6-f13f-4b12-b98b-35b7e8444f4d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:16.500626 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49eafb6-f13f-4b12-b98b-35b7e8444f4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:16.509659 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-f49eafb6-f13f-4b12-b98b-35b7e8444f4d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:14:16.509659 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:16.509659 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:16.509659 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:16.509659 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:16.509659 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:16.509659 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:16.509659 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:16.509659 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:16.509659 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:16.509659 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:16.509659 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:16.509659 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:16.509659 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:16.509659 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:16.509659 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:16.510618 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:16.510618 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:16.510618 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:16.510618 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:16.510618 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:16.510618 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:16.510618 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:16.510618 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:16.510618 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:16.510618 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:16.510618 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:16.510618 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:16.510618 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:16.510618 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:16.510618 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:16.510618 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:16.511414 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:16.511414 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:16.511414 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:16.511414 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:16.511414 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:16.511414 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:16.511414 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:16.511414 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:16.511414 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:16.511414 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:16.511414 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 17:14:16.511414 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:16.511414 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 217/444] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 24 17:14:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:16.512059 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49eafb6-f13f-4b12-b98b-35b7e8444f4d None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:16.536496 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989d881-818d-4611-8636-6336898ea467 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:16.537926 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989d881-818d-4611-8636-6336898ea467 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:16.589519 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:16.612631 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49eafb6-f13f-4b12-b98b-35b7e8444f4d None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:16.638050 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 228/445] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:14:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:14:16.639017 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989d881-818d-4611-8636-6336898ea467 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:16.650742 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1c692-295b-47c7-8fa0-39a1c6ae742b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:16.651607 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1c692-295b-47c7-8fa0-39a1c6ae742b None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:16.651880 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1c692-295b-47c7-8fa0-39a1c6ae742b None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:16.652148 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1c692-295b-47c7-8fa0-39a1c6ae742b None admin] PATH_INFO: `/v3/groups/1c85486e99b74c88b2aff14d748ff4ea` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:16.653321 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1c692-295b-47c7-8fa0-39a1c6ae742b None admin] RBAC: Authorizing `identity:get_group(group_id=1c85486e99b74c88b2aff14d748ff4ea)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:16.654843 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1c692-295b-47c7-8fa0-39a1c6ae742b None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:16.656711 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 218/446] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 24 17:14:16 2022] GET /identity/v3/groups/1c85486e99b74c88b2aff14d748ff4ea => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:16.657461 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1c692-295b-47c7-8fa0-39a1c6ae742b None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:16.680474 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:16.736834 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989d881-818d-4611-8636-6336898ea467 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:16.756550 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1c692-295b-47c7-8fa0-39a1c6ae742b None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:16.771059 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48105b6-f8bc-4f26-a4f5-bece9967af67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:16.771722 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48105b6-f8bc-4f26-a4f5-bece9967af67 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:16.771996 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48105b6-f8bc-4f26-a4f5-bece9967af67 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:16.772268 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48105b6-f8bc-4f26-a4f5-bece9967af67 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:16.773028 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48105b6-f8bc-4f26-a4f5-bece9967af67 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:16.773354 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48105b6-f8bc-4f26-a4f5-bece9967af67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:16.774749 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48105b6-f8bc-4f26-a4f5-bece9967af67 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:16.783044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 229/447] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:16.783821 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48105b6-f8bc-4f26-a4f5-bece9967af67 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:16.789340 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0a87e-964e-4f62-ae6c-b3d8e00cd264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:16.790209 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0a87e-964e-4f62-ae6c-b3d8e00cd264 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:16.790486 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0a87e-964e-4f62-ae6c-b3d8e00cd264 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:16.790794 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0a87e-964e-4f62-ae6c-b3d8e00cd264 None admin] PATH_INFO: `/v3/projects/df2ee206730346a086b9b4fdd7759036` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:16.791966 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0a87e-964e-4f62-ae6c-b3d8e00cd264 None admin] RBAC: Authorizing `identity:get_project(project_id=df2ee206730346a086b9b4fdd7759036)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:16.793397 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0a87e-964e-4f62-ae6c-b3d8e00cd264 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:16.795247 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 219/448] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:14:16 2022] GET /identity/v3/projects/df2ee206730346a086b9b4fdd7759036 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:16.795937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0a87e-964e-4f62-ae6c-b3d8e00cd264 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:16.810736 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:16.887600 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48105b6-f8bc-4f26-a4f5-bece9967af67 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:16.889058 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:16.893182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0a87e-964e-4f62-ae6c-b3d8e00cd264 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:16.924007 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c7544-e0d6-4e7c-90bc-826646b59be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:16.924660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c7544-e0d6-4e7c-90bc-826646b59be5 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:16.924936 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c7544-e0d6-4e7c-90bc-826646b59be5 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:16.925206 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c7544-e0d6-4e7c-90bc-826646b59be5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:16.926029 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c7544-e0d6-4e7c-90bc-826646b59be5 None admin] RBAC: Adding query filter params (group.id=1c85486e99b74c88b2aff14d748ff4ea, role.id=ee8d50c25f9347d5b99d4a346f7c2fa8, scope.project.id=20fbbdffa9b84d99b150f2395751706c) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:16.926336 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c7544-e0d6-4e7c-90bc-826646b59be5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:16.927330 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5888684-4a7a-4057-9a60-128ce0baec48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:16.927825 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c7544-e0d6-4e7c-90bc-826646b59be5 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:16.928018 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5888684-4a7a-4057-9a60-128ce0baec48 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:16.928235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5888684-4a7a-4057-9a60-128ce0baec48 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:16.928503 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5888684-4a7a-4057-9a60-128ce0baec48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:16.934163 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 230/449] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Jun 24 17:14:16 2022] GET /identity/v3/role_assignments?group.id=1c85486e99b74c88b2aff14d748ff4ea&scope.project.id=20fbbdffa9b84d99b150f2395751706c&role.id=ee8d50c25f9347d5b99d4a346f7c2fa8 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:16.935013 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c7544-e0d6-4e7c-90bc-826646b59be5 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:17.019926 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5888684-4a7a-4057-9a60-128ce0baec48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:17.021551 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5888684-4a7a-4057-9a60-128ce0baec48 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:17.039555 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:17.068062 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c7544-e0d6-4e7c-90bc-826646b59be5 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:17.107474 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50885a30-1d2a-4402-8d75-1f3d9cc97dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:17.108351 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50885a30-1d2a-4402-8d75-1f3d9cc97dfe None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:17.108627 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50885a30-1d2a-4402-8d75-1f3d9cc97dfe None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:17.109429 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50885a30-1d2a-4402-8d75-1f3d9cc97dfe None admin] PATH_INFO: `/v3/groups/912d05b2eda04f1c9b8466e8369dc612` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:17.111884 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50885a30-1d2a-4402-8d75-1f3d9cc97dfe None admin] RBAC: Authorizing `identity:get_group(group_id=912d05b2eda04f1c9b8466e8369dc612)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:17.114228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50885a30-1d2a-4402-8d75-1f3d9cc97dfe None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:17.116150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 231/450] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 24 17:14:16 2022] GET /identity/v3/groups/912d05b2eda04f1c9b8466e8369dc612 => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:17.122223 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50885a30-1d2a-4402-8d75-1f3d9cc97dfe None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:17.141414 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 220/451] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:14:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:14:17.146807 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5888684-4a7a-4057-9a60-128ce0baec48 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:17.165025 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:17.250809 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50885a30-1d2a-4402-8d75-1f3d9cc97dfe None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:17.271894 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5888684-4a7a-4057-9a60-128ce0baec48 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:17.286893 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:17.292547 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d00f7a-3e64-4acc-b32a-518318c180a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:17.293200 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d00f7a-3e64-4acc-b32a-518318c180a5 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:17.293474 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d00f7a-3e64-4acc-b32a-518318c180a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:17.297083 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d00f7a-3e64-4acc-b32a-518318c180a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:17.297083 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d00f7a-3e64-4acc-b32a-518318c180a5 None admin] RBAC: Adding query filter params (group.id=912d05b2eda04f1c9b8466e8369dc612, role.id=ae295b7c396a4e559ecd6d574f097d4a, scope.project.id=df2ee206730346a086b9b4fdd7759036) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:17.297083 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d00f7a-3e64-4acc-b32a-518318c180a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:17.297083 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d00f7a-3e64-4acc-b32a-518318c180a5 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:17.303617 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 232/452] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Jun 24 17:14:17 2022] GET /identity/v3/role_assignments?group.id=912d05b2eda04f1c9b8466e8369dc612&scope.project.id=df2ee206730346a086b9b4fdd7759036&role.id=ae295b7c396a4e559ecd6d574f097d4a => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:17.323353 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b8eca-a54b-45a9-9f0e-e065b9b081bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:17.324256 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b8eca-a54b-45a9-9f0e-e065b9b081bc None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:17.324530 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b8eca-a54b-45a9-9f0e-e065b9b081bc None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:17.324799 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b8eca-a54b-45a9-9f0e-e065b9b081bc None admin] PATH_INFO: `/v3/projects/08f7023404fc4480a32378a0d7e2f040` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:17.326138 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b8eca-a54b-45a9-9f0e-e065b9b081bc None admin] RBAC: Authorizing `identity:get_project(project_id=08f7023404fc4480a32378a0d7e2f040)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:17.327656 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b8eca-a54b-45a9-9f0e-e065b9b081bc None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:17.329453 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 221/453] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 24 17:14:17 2022] GET /identity/v3/projects/08f7023404fc4480a32378a0d7e2f040 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:17.335338 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d00f7a-3e64-4acc-b32a-518318c180a5 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:17.445445 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:17.450044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d00f7a-3e64-4acc-b32a-518318c180a5 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:17.488219 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a8075-4f5b-45dc-b328-64f63b0c6ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:17.489114 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a8075-4f5b-45dc-b328-64f63b0c6ee8 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:17.489387 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a8075-4f5b-45dc-b328-64f63b0c6ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:17.489653 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a8075-4f5b-45dc-b328-64f63b0c6ee8 None admin] PATH_INFO: `/v3/groups/1c85486e99b74c88b2aff14d748ff4ea` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:17.490895 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a8075-4f5b-45dc-b328-64f63b0c6ee8 None admin] RBAC: Authorizing `identity:get_group(group_id=1c85486e99b74c88b2aff14d748ff4ea)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:17.492490 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a8075-4f5b-45dc-b328-64f63b0c6ee8 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:17.494432 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 233/454] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 24 17:14:17 2022] GET /identity/v3/groups/1c85486e99b74c88b2aff14d748ff4ea => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:17.500087 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b8eca-a54b-45a9-9f0e-e065b9b081bc None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:17.603918 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b8eca-a54b-45a9-9f0e-e065b9b081bc None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:17.640478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa40d6-5a72-4647-87f8-a825503e64ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:17.641109 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa40d6-5a72-4647-87f8-a825503e64ba None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:17.641386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa40d6-5a72-4647-87f8-a825503e64ba None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:17.641658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa40d6-5a72-4647-87f8-a825503e64ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:17.642478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa40d6-5a72-4647-87f8-a825503e64ba None admin] RBAC: Adding query filter params (group.id=1c85486e99b74c88b2aff14d748ff4ea, role.id=bbc0c8e77a594880a35aae1d21773668, scope.project.id=08f7023404fc4480a32378a0d7e2f040) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:17.642820 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa40d6-5a72-4647-87f8-a825503e64ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:17.644265 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa40d6-5a72-4647-87f8-a825503e64ba None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:17.650749 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 222/455] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Jun 24 17:14:17 2022] GET /identity/v3/role_assignments?group.id=1c85486e99b74c88b2aff14d748ff4ea&scope.project.id=08f7023404fc4480a32378a0d7e2f040&role.id=bbc0c8e77a594880a35aae1d21773668 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:20.441998 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4686d-0776-42a6-b4da-cae167b20197 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:20.443038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4686d-0776-42a6-b4da-cae167b20197 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:20.443530 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4686d-0776-42a6-b4da-cae167b20197 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:20.445395 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 234/456] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:20.450845 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21104f4-92a5-4ebc-8f47-18d13d732402 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:20.451641 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21104f4-92a5-4ebc-8f47-18d13d732402 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:20.452116 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21104f4-92a5-4ebc-8f47-18d13d732402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:20.469771 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-d21104f4-92a5-4ebc-8f47-18d13d732402 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:20.471292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-d21104f4-92a5-4ebc-8f47-18d13d732402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:20.514259 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:20.549547 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 223/457] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:20.575783 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4686d-0776-42a6-b4da-cae167b20197 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:20.594543 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950a121-ff4f-4f9e-8624-2a92a280c54c None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:20.594916 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950a121-ff4f-4f9e-8624-2a92a280c54c None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:20.595114 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950a121-ff4f-4f9e-8624-2a92a280c54c None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:20.596722 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 224/458] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 17:14:20.604762 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6200e31-5a3d-4117-8891-de6f870bf583 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:20.605400 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6200e31-5a3d-4117-8891-de6f870bf583 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:20.605865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6200e31-5a3d-4117-8891-de6f870bf583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:20.625611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-d6200e31-5a3d-4117-8891-de6f870bf583 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:20.627298 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-d6200e31-5a3d-4117-8891-de6f870bf583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:20.701495 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 225/459] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 17:14:20.705008 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4686d-0776-42a6-b4da-cae167b20197 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:20.728679 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6200e31-5a3d-4117-8891-de6f870bf583 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:20.743051 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2ff00-48fa-4b80-a0b9-43099e6f0006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:20.744185 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2ff00-48fa-4b80-a0b9-43099e6f0006 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:20.744472 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2ff00-48fa-4b80-a0b9-43099e6f0006 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:20.744748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2ff00-48fa-4b80-a0b9-43099e6f0006 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:20.760279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2ff00-48fa-4b80-a0b9-43099e6f0006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:20.761953 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2ff00-48fa-4b80-a0b9-43099e6f0006 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:20.786373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-0ff2ff00-48fa-4b80-a0b9-43099e6f0006 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:20.786373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:20.786373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:20.786373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:20.786373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:20.786373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:20.786373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:20.786373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:20.786373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:20.786373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:20.786373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:20.786373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:20.786373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:20.786373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:20.786373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:20.787342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:20.787342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:20.787342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:20.787342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:20.787342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:20.787342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:20.787342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:20.787342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:20.787342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:20.787342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:20.787342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:20.787342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:20.787342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:20.787342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:20.787342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:20.787342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:20.787342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:20.788169 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:20.788169 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:20.788169 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:20.788169 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:20.788169 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 235/460] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:20.795112 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2ff00-48fa-4b80-a0b9-43099e6f0006 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:20.816355 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:20.847378 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6200e31-5a3d-4117-8891-de6f870bf583 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:20.849976 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:20.884431 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7edf9-5bb7-4e21-a396-abdca580e00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:20.885239 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7edf9-5bb7-4e21-a396-abdca580e00d None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:20.885513 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7edf9-5bb7-4e21-a396-abdca580e00d None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:20.885783 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7edf9-5bb7-4e21-a396-abdca580e00d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:20.896057 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7edf9-5bb7-4e21-a396-abdca580e00d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:20.897524 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7edf9-5bb7-4e21-a396-abdca580e00d None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:20.907944 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2ff00-48fa-4b80-a0b9-43099e6f0006 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:20.915803 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-ecc7edf9-5bb7-4e21-a396-abdca580e00d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:20.915803 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:20.915803 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:20.915803 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:20.915803 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:20.915803 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:20.915803 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:20.915803 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:20.915803 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:20.915803 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:20.915803 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:20.915803 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:20.915803 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:20.915803 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:20.915803 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:20.916641 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:20.916641 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:20.916641 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:20.916641 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:20.916641 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:20.916641 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:20.916641 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:20.916641 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:20.916641 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:20.916641 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:20.916641 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:20.916641 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:20.916641 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:20.916641 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:20.916641 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:20.916641 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:20.916641 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:20.918098 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:20.918098 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:20.918098 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:20.918098 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:20.918098 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 226/461] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:14:20.918622 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178a523-8e31-4aa9-a9c2-5d5edd0e69a2 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:20.918886 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178a523-8e31-4aa9-a9c2-5d5edd0e69a2 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:20.919159 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178a523-8e31-4aa9-a9c2-5d5edd0e69a2 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:20.924631 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 227/462] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:20.924631 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178a523-8e31-4aa9-a9c2-5d5edd0e69a2 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:20.949476 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff52d94-0df6-41f9-95fd-cd81bbb16456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:20.950297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff52d94-0df6-41f9-95fd-cd81bbb16456 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:20.950681 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff52d94-0df6-41f9-95fd-cd81bbb16456 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:20.951055 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff52d94-0df6-41f9-95fd-cd81bbb16456 None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:20.951894 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff52d94-0df6-41f9-95fd-cd81bbb16456 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:20.952193 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff52d94-0df6-41f9-95fd-cd81bbb16456 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:20.953570 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff52d94-0df6-41f9-95fd-cd81bbb16456 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:20.971064 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 236/463] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:20.972327 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38122fe-47c7-4b0e-bf40-b78858ac8b04 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:20.972603 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38122fe-47c7-4b0e-bf40-b78858ac8b04 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:20.972872 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38122fe-47c7-4b0e-bf40-b78858ac8b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:20.989529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-f38122fe-47c7-4b0e-bf40-b78858ac8b04 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:20.990748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-f38122fe-47c7-4b0e-bf40-b78858ac8b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:21.031874 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178a523-8e31-4aa9-a9c2-5d5edd0e69a2 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:21.058749 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 237/464] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:21.059803 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38122fe-47c7-4b0e-bf40-b78858ac8b04 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:21.068585 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d99ab7-c85c-411c-8c15-01b694e1d739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:21.069633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:21.069872 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d99ab7-c85c-411c-8c15-01b694e1d739 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:21.070686 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d99ab7-c85c-411c-8c15-01b694e1d739 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:21.071059 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d99ab7-c85c-411c-8c15-01b694e1d739 None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:21.072066 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d99ab7-c85c-411c-8c15-01b694e1d739 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:21.072374 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d99ab7-c85c-411c-8c15-01b694e1d739 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:21.074132 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d99ab7-c85c-411c-8c15-01b694e1d739 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:21.092551 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 228/465] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:21.092551 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2d039-f8fa-47ef-b181-b33491363bd9 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:21.092551 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2d039-f8fa-47ef-b181-b33491363bd9 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:21.092551 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2d039-f8fa-47ef-b181-b33491363bd9 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:21.092551 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 229/466] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:21.092551 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2d039-f8fa-47ef-b181-b33491363bd9 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:21.110535 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:21.165324 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38122fe-47c7-4b0e-bf40-b78858ac8b04 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:21.195182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2d039-f8fa-47ef-b181-b33491363bd9 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:21.198384 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5733a65-7756-4aca-ab28-b075cfcd84b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:21.199073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5733a65-7756-4aca-ab28-b075cfcd84b3 None admin] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:21.199350 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5733a65-7756-4aca-ab28-b075cfcd84b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:21.199622 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5733a65-7756-4aca-ab28-b075cfcd84b3 None admin] PATH_INFO: `/v3/users` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:21.200312 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5733a65-7756-4aca-ab28-b075cfcd84b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:21.201770 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5733a65-7756-4aca-ab28-b075cfcd84b3 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:21.221803 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 238/467] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 24 17:14:21 2022] POST /identity/v3/users => generated 246 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:14:21.222529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5733a65-7756-4aca-ab28-b075cfcd84b3 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:21.231269 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a664181-edcd-4181-bb04-334cbdfaa53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:21.232115 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a664181-edcd-4181-bb04-334cbdfaa53c None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:21.232893 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a664181-edcd-4181-bb04-334cbdfaa53c None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:21.233242 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a664181-edcd-4181-bb04-334cbdfaa53c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:21.247097 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a664181-edcd-4181-bb04-334cbdfaa53c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:21.248650 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a664181-edcd-4181-bb04-334cbdfaa53c None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:21.268307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-0a664181-edcd-4181-bb04-334cbdfaa53c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:21.268307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:21.268307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:21.268307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:21.268307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:21.268307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:21.268307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:21.268307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:21.268307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:21.268307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:21.268307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:21.268307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:21.268307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:21.268307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:21.268307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:21.269245 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:21.269245 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:21.269245 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:21.269245 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:21.269245 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:21.269245 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:21.269245 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:21.269245 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:21.269245 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:21.269245 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:21.269245 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:21.269245 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:21.269245 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:21.269245 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:21.269245 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:21.269245 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:21.269245 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:21.270070 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:21.270070 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:21.270070 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:21.270070 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:21.270070 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 230/468] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:21.270840 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4eae8-0a1d-491a-9ab7-016c3e492c23 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:21.271121 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4eae8-0a1d-491a-9ab7-016c3e492c23 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:21.271395 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4eae8-0a1d-491a-9ab7-016c3e492c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:21.292397 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-7fa4eae8-0a1d-491a-9ab7-016c3e492c23 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:21.293648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-7fa4eae8-0a1d-491a-9ab7-016c3e492c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:21.304630 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:21.350136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5733a65-7756-4aca-ab28-b075cfcd84b3 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:21.371207 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:21.384040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 231/469] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:21.384040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4eae8-0a1d-491a-9ab7-016c3e492c23 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:21.390027 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba3c02-348c-41e7-8f17-ea8f0bf8c753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:21.390819 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba3c02-348c-41e7-8f17-ea8f0bf8c753 None admin] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:21.391098 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba3c02-348c-41e7-8f17-ea8f0bf8c753 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:21.391370 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba3c02-348c-41e7-8f17-ea8f0bf8c753 None admin] PATH_INFO: `/v3/users` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:21.392080 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba3c02-348c-41e7-8f17-ea8f0bf8c753 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:21.393882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba3c02-348c-41e7-8f17-ea8f0bf8c753 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:21.419824 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 239/470] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 24 17:14:21 2022] POST /identity/v3/users => generated 248 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:14:21.420495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba3c02-348c-41e7-8f17-ea8f0bf8c753 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:21.517451 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4eae8-0a1d-491a-9ab7-016c3e492c23 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:21.557908 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba3c02-348c-41e7-8f17-ea8f0bf8c753 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:21.566270 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbb1ab-dada-4fcb-91a2-3ece1669e9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:21.567283 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbb1ab-dada-4fcb-91a2-3ece1669e9c8 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:21.567707 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbb1ab-dada-4fcb-91a2-3ece1669e9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:21.568500 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbb1ab-dada-4fcb-91a2-3ece1669e9c8 None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:21.569795 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbb1ab-dada-4fcb-91a2-3ece1669e9c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:21.570252 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbb1ab-dada-4fcb-91a2-3ece1669e9c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:21.572147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbb1ab-dada-4fcb-91a2-3ece1669e9c8 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:21.589368 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 232/471] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:21.594561 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:21.595437 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbb1ab-dada-4fcb-91a2-3ece1669e9c8 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:21.600579 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaab0e6-a3cc-4bee-a00c-5e1871b95450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:21.602524 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaab0e6-a3cc-4bee-a00c-5e1871b95450 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:21.604098 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaab0e6-a3cc-4bee-a00c-5e1871b95450 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:21.604529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaab0e6-a3cc-4bee-a00c-5e1871b95450 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:21.620172 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaab0e6-a3cc-4bee-a00c-5e1871b95450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:21.621899 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaab0e6-a3cc-4bee-a00c-5e1871b95450 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:21.644721 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-0aaab0e6-a3cc-4bee-a00c-5e1871b95450 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:21.644721 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:21.644721 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:21.644721 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:21.644721 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:21.644721 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:21.644721 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:21.644721 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:21.644721 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:21.644721 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:21.644721 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:21.644721 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:21.644721 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:21.644721 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:21.644721 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:21.645614 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:21.645614 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:21.645614 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:21.645614 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:21.645614 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:21.645614 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:21.645614 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:21.645614 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:21.645614 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:21.645614 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:21.645614 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:21.645614 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:21.645614 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:21.645614 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:21.645614 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:21.645614 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:21.645614 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:21.646435 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:21.646435 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:21.646435 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:21.646435 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:21.647112 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 240/472] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:21.653438 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaab0e6-a3cc-4bee-a00c-5e1871b95450 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:21.674531 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:21.725132 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbb1ab-dada-4fcb-91a2-3ece1669e9c8 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:21.761430 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe321f-b1ef-4398-a17c-0568862cf410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:21.762108 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe321f-b1ef-4398-a17c-0568862cf410 None admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:21.762384 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe321f-b1ef-4398-a17c-0568862cf410 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:21.762683 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe321f-b1ef-4398-a17c-0568862cf410 None admin] PATH_INFO: `/v3/users` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:21.763390 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe321f-b1ef-4398-a17c-0568862cf410 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:21.765026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe321f-b1ef-4398-a17c-0568862cf410 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:21.775595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaab0e6-a3cc-4bee-a00c-5e1871b95450 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:21.798893 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 233/473] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 24 17:14:21 2022] POST /identity/v3/users => generated 248 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:14:21.815269 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10b7fb-0314-49ad-a1c4-1402e5bb0f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:21.816368 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10b7fb-0314-49ad-a1c4-1402e5bb0f53 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:21.816833 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10b7fb-0314-49ad-a1c4-1402e5bb0f53 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:21.817287 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10b7fb-0314-49ad-a1c4-1402e5bb0f53 None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:21.818219 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10b7fb-0314-49ad-a1c4-1402e5bb0f53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:21.818771 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10b7fb-0314-49ad-a1c4-1402e5bb0f53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:21.820576 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10b7fb-0314-49ad-a1c4-1402e5bb0f53 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:21.835427 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 241/474] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:21.841514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe321f-b1ef-4398-a17c-0568862cf410 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:21.956409 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe321f-b1ef-4398-a17c-0568862cf410 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:21.972486 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:21.995858 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96da381-ceaa-4c9d-9642-e0050a6f8a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:21.996545 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96da381-ceaa-4c9d-9642-e0050a6f8a81 None admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:21.996823 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96da381-ceaa-4c9d-9642-e0050a6f8a81 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:21.997099 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96da381-ceaa-4c9d-9642-e0050a6f8a81 None admin] PATH_INFO: `/v3/users` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:21.997827 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96da381-ceaa-4c9d-9642-e0050a6f8a81 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:21.999324 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96da381-ceaa-4c9d-9642-e0050a6f8a81 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:22.023100 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 234/475] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 24 17:14:21 2022] POST /identity/v3/users => generated 249 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:14:23.667695 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33274c76-c206-490a-9a86-26479036bd99 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:23.668255 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33274c76-c206-490a-9a86-26479036bd99 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:23.668255 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33274c76-c206-490a-9a86-26479036bd99 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:23.669885 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 242/476] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:23.675577 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483cf98-c112-46cb-9cc0-d94b56d23377 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:23.676002 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483cf98-c112-46cb-9cc0-d94b56d23377 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:23.676175 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483cf98-c112-46cb-9cc0-d94b56d23377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:23.693600 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-1483cf98-c112-46cb-9cc0-d94b56d23377 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:23.694879 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-1483cf98-c112-46cb-9cc0-d94b56d23377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:23.768783 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 235/477] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 17:14:23.794269 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33274c76-c206-490a-9a86-26479036bd99 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:23.832508 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:23.857656 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e6551-cce0-4281-85c2-49209d87df81 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:23.857971 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e6551-cce0-4281-85c2-49209d87df81 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:23.858200 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e6551-cce0-4281-85c2-49209d87df81 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:23.859937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 236/478] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 17:14:23.868562 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856cf8e-c2f7-44f7-954f-acda19bb5ed9 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:23.869077 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856cf8e-c2f7-44f7-954f-acda19bb5ed9 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:23.869721 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856cf8e-c2f7-44f7-954f-acda19bb5ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:23.890636 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-4856cf8e-c2f7-44f7-954f-acda19bb5ed9 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:23.891832 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-4856cf8e-c2f7-44f7-954f-acda19bb5ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:23.930918 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33274c76-c206-490a-9a86-26479036bd99 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:23.974552 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca12d9-92a6-4f90-b5cf-470d4b4f2b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:23.980038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca12d9-92a6-4f90-b5cf-470d4b4f2b1a None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:23.980325 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca12d9-92a6-4f90-b5cf-470d4b4f2b1a None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:23.980604 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca12d9-92a6-4f90-b5cf-470d4b4f2b1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:23.983003 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 237/479] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 17:14:23.993801 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca12d9-92a6-4f90-b5cf-470d4b4f2b1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:24.001836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-e6ca12d9-92a6-4f90-b5cf-470d4b4f2b1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:24.001836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:24.001836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:24.001836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:24.001836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:24.001836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:24.001836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:24.001836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:24.001836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:24.001836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:24.001836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:24.001836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:24.001836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:24.001836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:24.001836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:24.001836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:24.002925 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:24.002925 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:24.002925 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:24.002925 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:24.002925 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:24.002925 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:24.002925 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:24.002925 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:24.002925 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:24.002925 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:24.002925 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:24.002925 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:24.002925 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:24.002925 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:24.002925 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:24.002925 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:24.003725 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:24.003725 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:24.003725 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:24.003725 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:24.003725 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:24.003725 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:24.003725 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:24.003725 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:24.003725 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:24.003725 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:24.003725 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:24.003725 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:24.004320 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 243/480] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 24 17:14:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:24.008568 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856cf8e-c2f7-44f7-954f-acda19bb5ed9 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:24.010931 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca12d9-92a6-4f90-b5cf-470d4b4f2b1a None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:24.046562 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:24.134901 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856cf8e-c2f7-44f7-954f-acda19bb5ed9 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:24.159008 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:24.174379 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca12d9-92a6-4f90-b5cf-470d4b4f2b1a None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:24.185170 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e0df6-3dbf-4ee3-b064-0883373629ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:24.185997 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e0df6-3dbf-4ee3-b064-0883373629ae None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:24.186270 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e0df6-3dbf-4ee3-b064-0883373629ae None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:24.186534 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e0df6-3dbf-4ee3-b064-0883373629ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:24.204426 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e0df6-3dbf-4ee3-b064-0883373629ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:24.217214 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-3e9e0df6-3dbf-4ee3-b064-0883373629ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:24.217214 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:24.217214 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:24.217214 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:24.217214 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:24.217214 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:24.217214 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:24.217214 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:24.217214 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:24.217214 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:24.217214 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:24.217214 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:24.217214 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:24.217214 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:24.217214 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:24.217214 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:24.218380 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:24.218380 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:24.218380 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:24.218380 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:24.218380 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:24.218380 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:24.218380 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:24.218380 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:24.218380 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:24.218380 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:24.218380 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:24.218380 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:24.218380 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:24.218380 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:24.218380 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:24.218380 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:24.219976 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:24.219976 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:24.219976 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:24.219976 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:24.219976 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:24.219976 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:24.219976 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:24.219976 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:24.219976 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:24.219976 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:24.219976 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:24.219976 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:24.221333 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ef03a-e9ee-4f15-a5b5-e87ec0278511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:24.221491 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 238/481] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 24 17:14:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:24.221621 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ef03a-e9ee-4f15-a5b5-e87ec0278511 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:24.221621 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ef03a-e9ee-4f15-a5b5-e87ec0278511 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:24.221621 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ef03a-e9ee-4f15-a5b5-e87ec0278511 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:24.222605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ef03a-e9ee-4f15-a5b5-e87ec0278511 None admin] RBAC: Adding query filter params (name=service) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:24.222605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ef03a-e9ee-4f15-a5b5-e87ec0278511 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:24.226636 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ef03a-e9ee-4f15-a5b5-e87ec0278511 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:24.226928 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e0df6-3dbf-4ee3-b064-0883373629ae None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:24.241498 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 244/482] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 24 17:14:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:24.246844 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ef03a-e9ee-4f15-a5b5-e87ec0278511 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:24.341485 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:24.352930 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e0df6-3dbf-4ee3-b064-0883373629ae None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:24.370763 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ef03a-e9ee-4f15-a5b5-e87ec0278511 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:24.389816 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee94c90-cb69-4008-a0d7-9c0695f4dd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:24.390493 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee94c90-cb69-4008-a0d7-9c0695f4dd7b None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:24.390797 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee94c90-cb69-4008-a0d7-9c0695f4dd7b None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:24.391069 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee94c90-cb69-4008-a0d7-9c0695f4dd7b None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:24.391821 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee94c90-cb69-4008-a0d7-9c0695f4dd7b None admin] RBAC: Adding query filter params (name=service) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:24.392122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee94c90-cb69-4008-a0d7-9c0695f4dd7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:24.393549 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee94c90-cb69-4008-a0d7-9c0695f4dd7b None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:24.402461 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 239/483] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 24 17:14:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:24.405856 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43e450-d324-4ad1-a1c6-d9306d6c1bf5 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:24.405856 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43e450-d324-4ad1-a1c6-d9306d6c1bf5 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:24.405856 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43e450-d324-4ad1-a1c6-d9306d6c1bf5 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:24.405856 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 240/484] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:24.408190 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43e450-d324-4ad1-a1c6-d9306d6c1bf5 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:24.416967 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a56e6-02d8-4721-8fdd-5262f0d17c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:24.418230 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a56e6-02d8-4721-8fdd-5262f0d17c3c None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:24.418732 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a56e6-02d8-4721-8fdd-5262f0d17c3c None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:24.419183 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a56e6-02d8-4721-8fdd-5262f0d17c3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:24.433919 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a56e6-02d8-4721-8fdd-5262f0d17c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:24.435676 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a56e6-02d8-4721-8fdd-5262f0d17c3c None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:24.455375 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-bd1a56e6-02d8-4721-8fdd-5262f0d17c3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:24.455375 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:24.455375 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:24.455375 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:24.455375 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:24.455375 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:24.455375 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:24.455375 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:24.455375 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:24.455375 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:24.455375 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:24.455375 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:24.455375 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:24.455375 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:24.455375 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:24.456323 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:24.456323 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:24.456323 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:24.456323 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:24.456323 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:24.456323 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:24.456323 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:24.456323 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:24.456323 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:24.456323 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:24.456323 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:24.456323 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:24.456323 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:24.456323 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:24.456323 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:24.456323 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:24.456323 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:24.461987 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:24.461987 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:24.461987 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:24.461987 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:24.461987 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 245/485] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:24.461987 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b8948-dcb0-4af9-8da0-3a91ce7e6258 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:24.461987 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b8948-dcb0-4af9-8da0-3a91ce7e6258 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:24.461987 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b8948-dcb0-4af9-8da0-3a91ce7e6258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:24.474897 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:24.481507 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-438b8948-dcb0-4af9-8da0-3a91ce7e6258 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:24.482779 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-438b8948-dcb0-4af9-8da0-3a91ce7e6258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:24.536354 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43e450-d324-4ad1-a1c6-d9306d6c1bf5 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:24.555921 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 246/486] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:24.556778 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b8948-dcb0-4af9-8da0-3a91ce7e6258 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:24.579368 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060f804-d53a-4950-8446-0fd930a102ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:24.580724 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060f804-d53a-4950-8446-0fd930a102ca None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:24.581370 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060f804-d53a-4950-8446-0fd930a102ca None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:24.581799 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060f804-d53a-4950-8446-0fd930a102ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:24.593544 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060f804-d53a-4950-8446-0fd930a102ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:24.595160 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060f804-d53a-4950-8446-0fd930a102ca None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:24.612894 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-a060f804-d53a-4950-8446-0fd930a102ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:24.612894 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:24.612894 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:24.612894 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:24.612894 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:24.612894 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:24.612894 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:24.612894 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:24.612894 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:24.612894 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:24.612894 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:24.612894 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:24.612894 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:24.612894 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:24.612894 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:24.613815 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:24.613815 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:24.613815 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:24.613815 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:24.613815 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:24.613815 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:24.613815 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:24.613815 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:24.613815 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:24.613815 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:24.613815 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:24.613815 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:24.613815 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:24.613815 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:24.613815 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:24.613815 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:24.613815 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:24.615073 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:24.615073 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:24.615073 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:24.615073 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:24.615073 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 241/487] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:14:24.616120 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cf287-f9a4-4bfe-8fe4-f85e87109e26 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:24.616404 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cf287-f9a4-4bfe-8fe4-f85e87109e26 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:24.616677 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cf287-f9a4-4bfe-8fe4-f85e87109e26 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:24.618047 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 242/488] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:24.619658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cf287-f9a4-4bfe-8fe4-f85e87109e26 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:24.623970 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:24.677327 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b8948-dcb0-4af9-8da0-3a91ce7e6258 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:24.717758 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b7475-8dcd-42a1-af8a-b3037c31e370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:24.718329 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b7475-8dcd-42a1-af8a-b3037c31e370 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:24.719827 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b7475-8dcd-42a1-af8a-b3037c31e370 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:24.720105 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b7475-8dcd-42a1-af8a-b3037c31e370 None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:24.721870 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b7475-8dcd-42a1-af8a-b3037c31e370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:24.722171 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b7475-8dcd-42a1-af8a-b3037c31e370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:24.724469 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b7475-8dcd-42a1-af8a-b3037c31e370 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:24.727986 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:24.738628 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cf287-f9a4-4bfe-8fe4-f85e87109e26 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:24.739272 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 247/489] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:24.740358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b7475-8dcd-42a1-af8a-b3037c31e370 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:24.773923 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e207ea9-1af3-43c0-891e-6fe902646178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:24.774763 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e207ea9-1af3-43c0-891e-6fe902646178 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:24.775047 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e207ea9-1af3-43c0-891e-6fe902646178 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:24.775321 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e207ea9-1af3-43c0-891e-6fe902646178 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:24.785971 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e207ea9-1af3-43c0-891e-6fe902646178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:24.794166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-5e207ea9-1af3-43c0-891e-6fe902646178 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:24.794166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:24.794166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:24.794166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:24.794166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:24.794166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:24.794166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:24.794166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:24.794166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:24.794166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:24.794166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:24.794166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:24.794166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:24.794166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:24.794166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:24.794166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:24.795185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:24.795185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:24.795185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:24.795185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:24.795185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:24.795185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:24.795185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:24.795185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:24.795185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:24.795185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:24.795185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:24.795185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:24.795185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:24.795185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:24.795185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:24.795185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:24.795992 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:24.795992 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:24.795992 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:24.795992 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:24.795992 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:24.795992 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:24.795992 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:24.795992 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:24.795992 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:24.795992 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:24.795992 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:24.795992 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:24.795992 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 243/490] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 24 17:14:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:24.796636 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe5134-e359-427e-863a-7bf303a1df4a None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:24.796866 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe5134-e359-427e-863a-7bf303a1df4a None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:24.797140 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe5134-e359-427e-863a-7bf303a1df4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:24.813985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-8afe5134-e359-427e-863a-7bf303a1df4a None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:24.815204 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-8afe5134-e359-427e-863a-7bf303a1df4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:24.846662 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b7475-8dcd-42a1-af8a-b3037c31e370 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:24.876556 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:24.883522 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c5b8a-1e15-41b3-87ba-651168cfeb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:24.884199 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c5b8a-1e15-41b3-87ba-651168cfeb12 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:24.884577 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c5b8a-1e15-41b3-87ba-651168cfeb12 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:24.884851 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c5b8a-1e15-41b3-87ba-651168cfeb12 None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:24.885569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c5b8a-1e15-41b3-87ba-651168cfeb12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:24.885872 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c5b8a-1e15-41b3-87ba-651168cfeb12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:24.886835 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 244/491] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:24.887296 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c5b8a-1e15-41b3-87ba-651168cfeb12 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:24.887437 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe5134-e359-427e-863a-7bf303a1df4a None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:24.904372 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 248/492] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:24.904372 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c5b8a-1e15-41b3-87ba-651168cfeb12 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:24.960374 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:24.990433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe5134-e359-427e-863a-7bf303a1df4a None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:25.006380 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c5b8a-1e15-41b3-87ba-651168cfeb12 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:25.026908 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bfb66-b441-45e6-93a1-eff165f96ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:25.027693 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bfb66-b441-45e6-93a1-eff165f96ffd None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:25.027964 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bfb66-b441-45e6-93a1-eff165f96ffd None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:25.028227 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bfb66-b441-45e6-93a1-eff165f96ffd None admin] PATH_INFO: `/v3/users/nova` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:25.035855 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755bfb66-b441-45e6-93a1-eff165f96ffd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:25.037314 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755bfb66-b441-45e6-93a1-eff165f96ffd None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:25.041478 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb779b-2fa2-4830-a559-5c9ddd59d3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:25.042135 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb779b-2fa2-4830-a559-5c9ddd59d3b9 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:25.042404 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb779b-2fa2-4830-a559-5c9ddd59d3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:25.042694 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb779b-2fa2-4830-a559-5c9ddd59d3b9 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:25.043424 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb779b-2fa2-4830-a559-5c9ddd59d3b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:25.043712 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb779b-2fa2-4830-a559-5c9ddd59d3b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:25.045065 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb779b-2fa2-4830-a559-5c9ddd59d3b9 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:25.052923 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 249/493] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 24 17:14:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:25.053062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-755bfb66-b441-45e6-93a1-eff165f96ffd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 17:14:25.053062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:25.053062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:25.053062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:25.053062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:25.053062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:25.053062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:25.053062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:25.053062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:25.053062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:25.053062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:25.053062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:25.053062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 17:14:25.053062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 17:14:25.053062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 17:14:25.053062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 17:14:25.053993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:25.053993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:25.053993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 17:14:25.053993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:25.053993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 17:14:25.053993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:25.053993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:25.053993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:25.053993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:25.053993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:25.053993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:25.053993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:25.053993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:25.053993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:25.053993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:25.053993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:25.053993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:25.053993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:25.055310 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:25.055310 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:25.055310 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 17:14:25.055310 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 17:14:25.055310 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 17:14:25.055310 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 17:14:25.055310 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 17:14:25.055310 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 17:14:25.055310 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 17:14:25.055310 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:25.056103 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb779b-2fa2-4830-a559-5c9ddd59d3b9 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:25.056210 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 245/494] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Jun 24 17:14:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:25.056210 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bfb66-b441-45e6-93a1-eff165f96ffd None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:25.112421 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:25.156795 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bfb66-b441-45e6-93a1-eff165f96ffd None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:25.157815 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb779b-2fa2-4830-a559-5c9ddd59d3b9 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:25.175748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:25.195266 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e53225-9091-452e-b560-f74333eea2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:25.195445 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8036f8-4bf8-491a-afc9-ebecab9cc040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:25.196060 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e53225-9091-452e-b560-f74333eea2e7 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:25.196153 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8036f8-4bf8-491a-afc9-ebecab9cc040 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:25.196332 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e53225-9091-452e-b560-f74333eea2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:25.196418 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8036f8-4bf8-491a-afc9-ebecab9cc040 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:25.196597 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e53225-9091-452e-b560-f74333eea2e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:25.196706 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8036f8-4bf8-491a-afc9-ebecab9cc040 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:25.205333 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8036f8-4bf8-491a-afc9-ebecab9cc040 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:25.206525 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e53225-9091-452e-b560-f74333eea2e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:25.206825 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8036f8-4bf8-491a-afc9-ebecab9cc040 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:25.214340 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-08e53225-9091-452e-b560-f74333eea2e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:25.214340 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:25.214340 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:25.214340 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:25.214340 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:25.214340 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:25.214340 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:25.214340 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:25.214340 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:25.214340 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:25.214340 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:25.214340 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:25.214340 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:25.214340 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:25.214340 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:25.214340 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:25.215243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:25.215243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:25.215243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:25.215243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:25.215243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:25.215243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:25.215243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:25.215243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:25.215243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:25.215243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:25.215243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:25.215243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:25.215243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:25.215243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:25.215243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:25.215243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:25.216032 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:25.216032 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:25.216032 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:25.216032 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:25.216032 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:25.216032 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:25.216032 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:25.216032 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:25.216032 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:25.216032 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:25.216032 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:25.216032 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:25.216032 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 246/495] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 24 17:14:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:25.216829 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e53225-9091-452e-b560-f74333eea2e7 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:25.222776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-1e8036f8-4bf8-491a-afc9-ebecab9cc040 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 17:14:25.222776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:25.222776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:25.222776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:25.222776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:25.222776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:25.222776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:25.222776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:25.222776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:25.222776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:25.222776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:25.222776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:25.222776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 17:14:25.222776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 17:14:25.222776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 17:14:25.222776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 17:14:25.223660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:25.223660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:25.223660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 17:14:25.223660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:25.223660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 17:14:25.223660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:25.223660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:25.223660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:25.223660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:25.223660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:25.223660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:25.223660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:25.223660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:25.223660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:25.223660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:25.223660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:25.223660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:25.223660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:25.224600 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:25.224600 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:25.224600 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 17:14:25.224600 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 17:14:25.224600 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 17:14:25.224600 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 17:14:25.224600 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 17:14:25.224600 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 17:14:25.224600 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 17:14:25.224600 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:25.224600 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 250/496] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:14:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:25.226597 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8036f8-4bf8-491a-afc9-ebecab9cc040 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:25.321988 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e53225-9091-452e-b560-f74333eea2e7 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:25.322173 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8036f8-4bf8-491a-afc9-ebecab9cc040 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:25.335484 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:25.356423 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35262c39-b8f6-4a54-b5e4-aa011b2b9221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:25.356633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b39f58-f538-419e-a632-6603e9040a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:25.357261 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35262c39-b8f6-4a54-b5e4-aa011b2b9221 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:25.357353 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b39f58-f538-419e-a632-6603e9040a90 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:25.357532 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35262c39-b8f6-4a54-b5e4-aa011b2b9221 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:25.357627 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b39f58-f538-419e-a632-6603e9040a90 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:25.357801 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b39f58-f538-419e-a632-6603e9040a90 None admin] PATH_INFO: `/v3/users` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:25.357894 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35262c39-b8f6-4a54-b5e4-aa011b2b9221 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:25.358665 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b39f58-f538-419e-a632-6603e9040a90 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:25.358968 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b39f58-f538-419e-a632-6603e9040a90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:25.360424 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b39f58-f538-419e-a632-6603e9040a90 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:25.368606 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35262c39-b8f6-4a54-b5e4-aa011b2b9221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:25.370034 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35262c39-b8f6-4a54-b5e4-aa011b2b9221 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:25.386937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-35262c39-b8f6-4a54-b5e4-aa011b2b9221 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:25.386937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:25.386937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:25.386937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:25.386937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:25.386937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:25.386937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:25.386937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:25.386937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:25.386937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:25.386937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:25.386937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:25.386937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:25.386937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:25.386937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:25.387839 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:25.387839 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:25.387839 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:25.387839 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:25.387839 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:25.387839 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:25.387839 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:25.387839 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:25.387839 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:25.387839 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:25.387839 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:25.387839 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:25.387839 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:25.387839 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:25.387839 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:25.387839 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:25.387839 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:25.388656 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:25.388656 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:25.388656 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:25.388656 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:25.388656 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 247/497] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:25.388918 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35262c39-b8f6-4a54-b5e4-aa011b2b9221 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:25.396894 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 251/498] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Jun 24 17:14:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:25.398055 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b39f58-f538-419e-a632-6603e9040a90 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:25.432710 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:25.493869 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35262c39-b8f6-4a54-b5e4-aa011b2b9221 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:25.496952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b39f58-f538-419e-a632-6603e9040a90 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:25.527611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f77556-af89-42a6-8538-a4b4059d7250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:25.528280 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f77556-af89-42a6-8538-a4b4059d7250 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:25.528582 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f77556-af89-42a6-8538-a4b4059d7250 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:25.528847 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f77556-af89-42a6-8538-a4b4059d7250 None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:25.529592 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f77556-af89-42a6-8538-a4b4059d7250 None admin] RBAC: Adding query filter params (name=service) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:25.529689 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dd838-d86d-40fc-90bd-693c6f7628d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:25.529894 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f77556-af89-42a6-8538-a4b4059d7250 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:25.530304 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dd838-d86d-40fc-90bd-693c6f7628d8 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:25.530591 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dd838-d86d-40fc-90bd-693c6f7628d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:25.530872 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dd838-d86d-40fc-90bd-693c6f7628d8 None admin] PATH_INFO: `/v3/users` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:25.531330 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f77556-af89-42a6-8538-a4b4059d7250 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:25.531688 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dd838-d86d-40fc-90bd-693c6f7628d8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:25.531987 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dd838-d86d-40fc-90bd-693c6f7628d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:25.533431 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dd838-d86d-40fc-90bd-693c6f7628d8 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:25.540256 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 248/499] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 24 17:14:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:25.541240 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f77556-af89-42a6-8538-a4b4059d7250 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:25.550938 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 252/500] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Jun 24 17:14:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:25.551881 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dd838-d86d-40fc-90bd-693c6f7628d8 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:25.576435 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:25.645119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:25.648950 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f77556-af89-42a6-8538-a4b4059d7250 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:25.652889 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dd838-d86d-40fc-90bd-693c6f7628d8 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:25.682304 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbb7b6-ac56-49a0-a284-a4d5ed122b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:25.683014 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbb7b6-ac56-49a0-a284-a4d5ed122b55 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:25.683292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbb7b6-ac56-49a0-a284-a4d5ed122b55 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:25.683536 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbb7b6-ac56-49a0-a284-a4d5ed122b55 None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:25.684281 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbb7b6-ac56-49a0-a284-a4d5ed122b55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:25.684577 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbb7b6-ac56-49a0-a284-a4d5ed122b55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:25.685962 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbb7b6-ac56-49a0-a284-a4d5ed122b55 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:25.687599 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f47c3-8b64-4713-b7aa-817aeba5db73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:25.688239 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f47c3-8b64-4713-b7aa-817aeba5db73 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:25.688514 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f47c3-8b64-4713-b7aa-817aeba5db73 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:25.688764 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f47c3-8b64-4713-b7aa-817aeba5db73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:25.697898 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 249/501] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:25.698593 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbb7b6-ac56-49a0-a284-a4d5ed122b55 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:25.754259 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f47c3-8b64-4713-b7aa-817aeba5db73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:25.755779 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f47c3-8b64-4713-b7aa-817aeba5db73 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:25.792332 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:25.804607 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbb7b6-ac56-49a0-a284-a4d5ed122b55 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:25.843158 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13317bc8-af6f-4fd2-9747-2256322357a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:25.843888 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13317bc8-af6f-4fd2-9747-2256322357a4 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:25.844168 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13317bc8-af6f-4fd2-9747-2256322357a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:25.844436 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13317bc8-af6f-4fd2-9747-2256322357a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:25.858604 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13317bc8-af6f-4fd2-9747-2256322357a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:25.860133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13317bc8-af6f-4fd2-9747-2256322357a4 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:25.885441 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-13317bc8-af6f-4fd2-9747-2256322357a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:25.885441 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:25.885441 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:25.885441 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:25.885441 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:25.885441 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:25.885441 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:25.885441 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:25.885441 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:25.885441 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:25.885441 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:25.885441 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:25.885441 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:25.885441 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:25.885441 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:25.886404 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:25.886404 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:25.886404 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:25.886404 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:25.886404 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:25.886404 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:25.886404 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:25.886404 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:25.886404 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:25.886404 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:25.886404 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:25.886404 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:25.886404 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:25.886404 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:25.886404 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:25.886404 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:25.886404 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:25.887259 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:25.887259 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:25.887259 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:25.887259 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:25.887259 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 250/502] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:25.887912 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13317bc8-af6f-4fd2-9747-2256322357a4 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:25.976049 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:25.984044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 253/503] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:14:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:14:25.984860 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f47c3-8b64-4713-b7aa-817aeba5db73 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:25.996761 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13317bc8-af6f-4fd2-9747-2256322357a4 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:26.031687 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea437b-c194-45b9-99da-2047989f0bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:26.032343 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea437b-c194-45b9-99da-2047989f0bd4 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:26.032620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea437b-c194-45b9-99da-2047989f0bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:26.032892 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea437b-c194-45b9-99da-2047989f0bd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:26.044061 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:26.084264 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f47c3-8b64-4713-b7aa-817aeba5db73 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:26.103548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea437b-c194-45b9-99da-2047989f0bd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:26.105140 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea437b-c194-45b9-99da-2047989f0bd4 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:26.120387 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937383a3-0bfe-4c67-8ee8-2fd3ad84d757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:26.121150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937383a3-0bfe-4c67-8ee8-2fd3ad84d757 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:26.121424 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937383a3-0bfe-4c67-8ee8-2fd3ad84d757 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:26.121694 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937383a3-0bfe-4c67-8ee8-2fd3ad84d757 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:26.128812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937383a3-0bfe-4c67-8ee8-2fd3ad84d757 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:26.130241 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937383a3-0bfe-4c67-8ee8-2fd3ad84d757 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:26.144814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-937383a3-0bfe-4c67-8ee8-2fd3ad84d757 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 17:14:26.144814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:26.144814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:26.144814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:26.144814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:26.144814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:26.144814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:26.144814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:26.144814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:26.144814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:26.144814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:26.144814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:26.144814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 17:14:26.144814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 17:14:26.144814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 17:14:26.144814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 17:14:26.145896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:26.145896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:26.145896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 17:14:26.145896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:26.145896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 17:14:26.145896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:26.145896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:26.145896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:26.145896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:26.145896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:26.145896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:26.145896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:26.145896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:26.145896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:26.145896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:26.145896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:26.145896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:26.145896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:26.146861 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:26.146861 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:26.146861 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 17:14:26.146861 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 17:14:26.146861 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 17:14:26.146861 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 17:14:26.146861 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 17:14:26.146861 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 17:14:26.146861 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 17:14:26.146861 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:26.146861 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 254/504] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:14:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:26.147779 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937383a3-0bfe-4c67-8ee8-2fd3ad84d757 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:26.205060 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:26.208711 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 251/505] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:14:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:14:26.209863 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea437b-c194-45b9-99da-2047989f0bd4 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:26.253071 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937383a3-0bfe-4c67-8ee8-2fd3ad84d757 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:26.262522 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:26.288213 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2cc6f-1028-4d24-ade8-7ce5112617cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:26.288869 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2cc6f-1028-4d24-ade8-7ce5112617cf None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:26.289136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2cc6f-1028-4d24-ade8-7ce5112617cf None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:26.289421 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2cc6f-1028-4d24-ade8-7ce5112617cf None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:26.290197 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2cc6f-1028-4d24-ade8-7ce5112617cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:26.290502 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2cc6f-1028-4d24-ade8-7ce5112617cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:26.291950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2cc6f-1028-4d24-ade8-7ce5112617cf None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:26.303281 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 255/506] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:26.304394 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2cc6f-1028-4d24-ade8-7ce5112617cf None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:26.329208 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea437b-c194-45b9-99da-2047989f0bd4 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:26.363509 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb33ec3-d867-4103-9618-ccbf3508bcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:26.364220 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb33ec3-d867-4103-9618-ccbf3508bcea None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:26.364496 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb33ec3-d867-4103-9618-ccbf3508bcea None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:26.364760 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb33ec3-d867-4103-9618-ccbf3508bcea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:26.374609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb33ec3-d867-4103-9618-ccbf3508bcea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:26.376040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb33ec3-d867-4103-9618-ccbf3508bcea None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:26.393379 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-9eb33ec3-d867-4103-9618-ccbf3508bcea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:26.393379 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:26.393379 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:26.393379 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:26.393379 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:26.393379 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:26.393379 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:26.393379 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:26.393379 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:26.393379 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:26.393379 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:26.393379 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:26.393379 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:26.393379 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:26.393379 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:26.394235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:26.394235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:26.394235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:26.394235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:26.394235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:26.394235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:26.394235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:26.394235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:26.394235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:26.394235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:26.394235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:26.394235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:26.394235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:26.394235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:26.394235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:26.394235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:26.394235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:26.395105 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:26.395105 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:26.395105 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:26.395105 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:26.395105 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 252/507] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:26.395365 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb33ec3-d867-4103-9618-ccbf3508bcea None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:26.407073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2cc6f-1028-4d24-ade8-7ce5112617cf None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:26.420897 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:26.440992 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed1e98-aade-4c5e-8d8f-579a1915b60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:26.441669 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed1e98-aade-4c5e-8d8f-579a1915b60a None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:26.441923 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed1e98-aade-4c5e-8d8f-579a1915b60a None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:26.442187 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed1e98-aade-4c5e-8d8f-579a1915b60a None admin] PATH_INFO: `/v3/users` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:26.443040 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed1e98-aade-4c5e-8d8f-579a1915b60a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:26.443342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed1e98-aade-4c5e-8d8f-579a1915b60a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:26.444870 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed1e98-aade-4c5e-8d8f-579a1915b60a None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:26.461516 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 256/508] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Jun 24 17:14:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:26.462309 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed1e98-aade-4c5e-8d8f-579a1915b60a None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:26.485438 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:26.496507 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb33ec3-d867-4103-9618-ccbf3508bcea None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:26.531008 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf36006-f551-4deb-ac0a-33604289fd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:26.531800 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf36006-f551-4deb-ac0a-33604289fd11 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:26.532074 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf36006-f551-4deb-ac0a-33604289fd11 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:26.532343 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf36006-f551-4deb-ac0a-33604289fd11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:26.542642 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf36006-f551-4deb-ac0a-33604289fd11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:26.544120 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf36006-f551-4deb-ac0a-33604289fd11 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:26.561864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-ecf36006-f551-4deb-ac0a-33604289fd11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:26.561864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:26.561864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:26.561864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:26.561864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:26.561864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:26.561864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:26.561864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:26.561864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:26.561864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:26.561864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:26.561864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:26.561864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:26.561864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:26.561864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:26.562761 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:26.562761 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:26.562761 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:26.562761 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:26.562761 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:26.562761 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:26.562761 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:26.562761 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:26.562761 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:26.562761 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:26.562761 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:26.562761 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:26.562761 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:26.562761 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:26.562761 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:26.562761 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:26.562761 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:26.563620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:26.563620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:26.563620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:26.563620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:26.563620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 253/509] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:26.563879 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf36006-f551-4deb-ac0a-33604289fd11 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:26.571313 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed1e98-aade-4c5e-8d8f-579a1915b60a None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:26.607427 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648232d-4952-43c1-9f2f-b8a2b02fbb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:26.608226 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648232d-4952-43c1-9f2f-b8a2b02fbb91 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:26.608497 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648232d-4952-43c1-9f2f-b8a2b02fbb91 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:26.608760 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648232d-4952-43c1-9f2f-b8a2b02fbb91 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:26.615932 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648232d-4952-43c1-9f2f-b8a2b02fbb91 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:26.617480 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648232d-4952-43c1-9f2f-b8a2b02fbb91 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:26.631645 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-f648232d-4952-43c1-9f2f-b8a2b02fbb91 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 17:14:26.631645 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:26.631645 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:26.631645 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:26.631645 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:26.631645 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:26.631645 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:26.631645 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:26.631645 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:26.631645 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:26.631645 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:26.631645 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:26.631645 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 17:14:26.631645 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 17:14:26.631645 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 17:14:26.631645 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 17:14:26.632699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:26.632699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:26.632699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 17:14:26.632699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:26.632699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 17:14:26.632699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:26.632699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:26.632699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:26.632699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:26.632699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:26.632699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:26.632699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:26.632699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:26.632699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:26.632699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:26.632699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:26.632699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:26.632699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:26.633812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:26.633812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:26.633812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 17:14:26.633812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 17:14:26.633812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 17:14:26.633812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 17:14:26.633812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 17:14:26.633812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 17:14:26.633812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 17:14:26.633812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:26.633812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 257/510] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 24 17:14:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:26.634514 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648232d-4952-43c1-9f2f-b8a2b02fbb91 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:26.660527 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf36006-f551-4deb-ac0a-33604289fd11 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:26.668136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:26.695040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dd132-bba7-4696-8735-c66a183f1477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:26.695701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dd132-bba7-4696-8735-c66a183f1477 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:26.695973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dd132-bba7-4696-8735-c66a183f1477 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:26.696232 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dd132-bba7-4696-8735-c66a183f1477 None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:26.696948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1dd132-bba7-4696-8735-c66a183f1477 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:26.697241 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1dd132-bba7-4696-8735-c66a183f1477 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:26.698723 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1dd132-bba7-4696-8735-c66a183f1477 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:26.710206 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 254/511] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:26.715618 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dd132-bba7-4696-8735-c66a183f1477 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:26.719587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:26.737628 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648232d-4952-43c1-9f2f-b8a2b02fbb91 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:26.771452 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10addb6f-283a-4b21-b07b-0c157be47f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:26.772149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10addb6f-283a-4b21-b07b-0c157be47f3c None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:26.772450 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10addb6f-283a-4b21-b07b-0c157be47f3c None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:26.772700 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10addb6f-283a-4b21-b07b-0c157be47f3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:26.815967 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dd132-bba7-4696-8735-c66a183f1477 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:26.839065 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10addb6f-283a-4b21-b07b-0c157be47f3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:26.840522 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10addb6f-283a-4b21-b07b-0c157be47f3c None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:26.848278 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba079883-55a7-4c32-91a9-d32ed30a8e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:26.848932 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba079883-55a7-4c32-91a9-d32ed30a8e63 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:26.849209 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba079883-55a7-4c32-91a9-d32ed30a8e63 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:26.849477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba079883-55a7-4c32-91a9-d32ed30a8e63 None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:26.850247 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba079883-55a7-4c32-91a9-d32ed30a8e63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:26.850986 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba079883-55a7-4c32-91a9-d32ed30a8e63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:26.853259 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba079883-55a7-4c32-91a9-d32ed30a8e63 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:26.865844 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 255/512] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:26.867285 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba079883-55a7-4c32-91a9-d32ed30a8e63 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:26.873333 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:26.931428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:26.945821 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 258/513] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:14:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:14:26.946686 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10addb6f-283a-4b21-b07b-0c157be47f3c None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:26.969838 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba079883-55a7-4c32-91a9-d32ed30a8e63 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:27.003450 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906d295-4820-4c84-a629-f71f684d789f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:27.004119 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906d295-4820-4c84-a629-f71f684d789f None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:27.004396 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906d295-4820-4c84-a629-f71f684d789f None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:27.004666 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906d295-4820-4c84-a629-f71f684d789f None admin] PATH_INFO: `/v3/users` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:27.005497 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906d295-4820-4c84-a629-f71f684d789f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:27.005800 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906d295-4820-4c84-a629-f71f684d789f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:27.007841 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906d295-4820-4c84-a629-f71f684d789f None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:27.045432 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 256/514] 10.222.0.15 () {56 vars in 1139 bytes} [Fri Jun 24 17:14:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:27.046284 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906d295-4820-4c84-a629-f71f684d789f None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:27.053497 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10addb6f-283a-4b21-b07b-0c157be47f3c None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:27.082773 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:27.088648 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3b3c3-c4f9-4c06-92f1-19f44177e2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:27.089419 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3b3c3-c4f9-4c06-92f1-19f44177e2ae None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:27.089696 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3b3c3-c4f9-4c06-92f1-19f44177e2ae None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:27.089972 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3b3c3-c4f9-4c06-92f1-19f44177e2ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:27.096647 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3b3c3-c4f9-4c06-92f1-19f44177e2ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:27.098132 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3b3c3-c4f9-4c06-92f1-19f44177e2ae None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:27.113082 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-f1c3b3c3-c4f9-4c06-92f1-19f44177e2ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:27.113082 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:27.113082 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:27.113082 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:27.113082 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:27.113082 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:27.113082 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:27.113082 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:27.113082 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:27.113082 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:27.113082 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:27.113082 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:27.113082 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 17:14:27.113082 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 17:14:27.113082 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 17:14:27.113956 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 17:14:27.113956 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:27.113956 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:27.113956 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:27.113956 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:27.113956 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:27.113956 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:27.113956 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:27.113956 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:27.113956 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:27.113956 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:27.113956 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:27.113956 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:27.113956 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:27.113956 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:27.113956 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:27.113956 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:27.114836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 17:14:27.114836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 17:14:27.114836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 17:14:27.114836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 17:14:27.114836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 17:14:27.114836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 17:14:27.114836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:27.114836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:27.114836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 259/515] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:27.115308 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3b3c3-c4f9-4c06-92f1-19f44177e2ae None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:27.154898 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906d295-4820-4c84-a629-f71f684d789f None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:27.177939 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:27.190395 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b31738-e52a-4940-a674-73dad2e9a3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:27.191265 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b31738-e52a-4940-a674-73dad2e9a3e6 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:27.191549 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b31738-e52a-4940-a674-73dad2e9a3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:27.191848 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b31738-e52a-4940-a674-73dad2e9a3e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:27.199203 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b31738-e52a-4940-a674-73dad2e9a3e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:27.200684 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b31738-e52a-4940-a674-73dad2e9a3e6 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:27.215233 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-56b31738-e52a-4940-a674-73dad2e9a3e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:27.215233 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:27.215233 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:27.215233 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:27.215233 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:27.215233 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:27.215233 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:27.215233 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:27.215233 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:27.215233 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:27.215233 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:27.215233 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:27.215233 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 17:14:27.215233 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 17:14:27.215233 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 17:14:27.216067 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 17:14:27.216067 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:27.216067 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:27.216067 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:27.216067 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:27.216067 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:27.216067 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:27.216067 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:27.216067 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:27.216067 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:27.216067 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:27.216067 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:27.216067 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:27.216067 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:27.216067 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:27.216067 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:27.216067 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:27.216886 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 17:14:27.216886 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 17:14:27.216886 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 17:14:27.216886 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 17:14:27.216886 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 17:14:27.216886 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 17:14:27.216886 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:27.216886 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:27.216886 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 257/516] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:27.217358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b31738-e52a-4940-a674-73dad2e9a3e6 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:27.217977 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3b3c3-c4f9-4c06-92f1-19f44177e2ae None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:27.253045 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3aa95e-7d9e-4f9b-b632-1432b166c0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:27.253838 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3aa95e-7d9e-4f9b-b632-1432b166c0d7 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:27.254119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3aa95e-7d9e-4f9b-b632-1432b166c0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:27.254390 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3aa95e-7d9e-4f9b-b632-1432b166c0d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:27.265678 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3aa95e-7d9e-4f9b-b632-1432b166c0d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:27.267158 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3aa95e-7d9e-4f9b-b632-1432b166c0d7 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:27.284521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-9f3aa95e-7d9e-4f9b-b632-1432b166c0d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:27.284521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:27.284521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:27.284521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:27.284521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:27.284521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:27.284521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:27.284521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:27.284521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:27.284521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:27.284521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:27.284521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:27.284521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:27.284521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:27.284521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:27.285411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:27.285411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:27.285411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:27.285411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:27.285411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:27.285411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:27.285411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:27.285411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:27.285411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:27.285411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:27.285411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:27.285411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:27.285411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:27.285411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:27.285411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:27.285411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:27.285411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:27.286255 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:27.286255 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:27.286255 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:27.286255 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:27.286255 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 260/517] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:27.286522 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3aa95e-7d9e-4f9b-b632-1432b166c0d7 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:27.329564 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b31738-e52a-4940-a674-73dad2e9a3e6 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:27.336779 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:27.365066 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fbca0-c08f-4984-ab95-bd0596db34e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:27.365801 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fbca0-c08f-4984-ab95-bd0596db34e5 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:27.366051 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fbca0-c08f-4984-ab95-bd0596db34e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:27.366316 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fbca0-c08f-4984-ab95-bd0596db34e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:27.391895 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3aa95e-7d9e-4f9b-b632-1432b166c0d7 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:27.413840 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:27.427800 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8e3a5-ec6c-4964-b282-5a7aabb33e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:27.428534 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8e3a5-ec6c-4964-b282-5a7aabb33e8d None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:27.428826 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8e3a5-ec6c-4964-b282-5a7aabb33e8d None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:27.429129 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8e3a5-ec6c-4964-b282-5a7aabb33e8d None admin] PATH_INFO: `/v3/projects` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:27.430079 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d8e3a5-ec6c-4964-b282-5a7aabb33e8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:27.430406 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d8e3a5-ec6c-4964-b282-5a7aabb33e8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:27.431863 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d8e3a5-ec6c-4964-b282-5a7aabb33e8d None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:27.432520 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fbca0-c08f-4984-ab95-bd0596db34e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:27.433993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fbca0-c08f-4984-ab95-bd0596db34e5 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:27.449326 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 261/518] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 24 17:14:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:27.450281 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8e3a5-ec6c-4964-b282-5a7aabb33e8d None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:27.530589 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 258/519] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:14:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:14:27.535244 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fbca0-c08f-4984-ab95-bd0596db34e5 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:27.549620 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8e3a5-ec6c-4964-b282-5a7aabb33e8d None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:27.551985 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:27.584597 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc6282-2bc1-48a2-af60-f1b59e143a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:27.585328 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc6282-2bc1-48a2-af60-f1b59e143a73 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:27.585710 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc6282-2bc1-48a2-af60-f1b59e143a73 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:27.585983 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc6282-2bc1-48a2-af60-f1b59e143a73 None admin] PATH_INFO: `/v3/projects` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:27.586792 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc6282-2bc1-48a2-af60-f1b59e143a73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:27.587096 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc6282-2bc1-48a2-af60-f1b59e143a73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:27.588528 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc6282-2bc1-48a2-af60-f1b59e143a73 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:27.599788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 262/520] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 24 17:14:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:27.601185 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc6282-2bc1-48a2-af60-f1b59e143a73 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:27.612902 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:27.633071 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fbca0-c08f-4984-ab95-bd0596db34e5 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:27.666855 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3da319-0003-4d7d-95a4-a65b976152af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:27.667433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3da319-0003-4d7d-95a4-a65b976152af None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:27.667705 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3da319-0003-4d7d-95a4-a65b976152af None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:27.667958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3da319-0003-4d7d-95a4-a65b976152af None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:27.668816 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3da319-0003-4d7d-95a4-a65b976152af None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:27.669112 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3da319-0003-4d7d-95a4-a65b976152af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:27.670476 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3da319-0003-4d7d-95a4-a65b976152af None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:27.681616 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 259/521] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:27.682402 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3da319-0003-4d7d-95a4-a65b976152af None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:27.700127 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc6282-2bc1-48a2-af60-f1b59e143a73 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:27.734236 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b7f9e-035b-4650-ae0c-dda1b7d05089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:27.734906 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b7f9e-035b-4650-ae0c-dda1b7d05089 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:27.735183 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b7f9e-035b-4650-ae0c-dda1b7d05089 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:27.735451 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b7f9e-035b-4650-ae0c-dda1b7d05089 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:27.736269 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b7f9e-035b-4650-ae0c-dda1b7d05089 None admin] RBAC: Adding query filter params (role.id=a10baa216e4941ad8d168a1f7825a966, scope.project.id=fb66039441c14b96a79a30de4a833fa2, user.id=9ff8200a750d49b1830c58f279e569c3) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:27.736572 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b7f9e-035b-4650-ae0c-dda1b7d05089 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:27.738003 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b7f9e-035b-4650-ae0c-dda1b7d05089 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:27.743756 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 263/522] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:14:27 2022] GET /identity/v3/role_assignments?user.id=9ff8200a750d49b1830c58f279e569c3&scope.project.id=fb66039441c14b96a79a30de4a833fa2&role.id=a10baa216e4941ad8d168a1f7825a966 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:27.744596 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b7f9e-035b-4650-ae0c-dda1b7d05089 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:27.774365 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:27.810452 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3da319-0003-4d7d-95a4-a65b976152af None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:27.847683 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf017f-f972-4dd4-a7f4-0b9c4d09d708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:27.848493 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf017f-f972-4dd4-a7f4-0b9c4d09d708 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:27.848758 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf017f-f972-4dd4-a7f4-0b9c4d09d708 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:27.849025 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf017f-f972-4dd4-a7f4-0b9c4d09d708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:27.861541 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf017f-f972-4dd4-a7f4-0b9c4d09d708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:27.863053 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf017f-f972-4dd4-a7f4-0b9c4d09d708 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:27.866044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b7f9e-035b-4650-ae0c-dda1b7d05089 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:27.866466 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:27.888548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-1ccf017f-f972-4dd4-a7f4-0b9c4d09d708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:27.888548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:27.888548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:27.888548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:27.888548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:27.888548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:27.888548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:27.888548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:27.888548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:27.888548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:27.888548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:27.888548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:27.888548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:27.888548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:27.888548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:27.889477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:27.889477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:27.889477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:27.889477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:27.889477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:27.889477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:27.889477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:27.889477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:27.889477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:27.889477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:27.889477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:27.889477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:27.889477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:27.889477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:27.889477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:27.889477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:27.889477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:27.890307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:27.890307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:27.890307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:27.890307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:27.890996 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 260/523] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:27.891604 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf017f-f972-4dd4-a7f4-0b9c4d09d708 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:27.908805 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcd20d-0ad9-4d94-b362-ef91a01c7b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:27.909592 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcd20d-0ad9-4d94-b362-ef91a01c7b7f None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:27.909928 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcd20d-0ad9-4d94-b362-ef91a01c7b7f None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:27.910258 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcd20d-0ad9-4d94-b362-ef91a01c7b7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:27.911204 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dcd20d-0ad9-4d94-b362-ef91a01c7b7f None admin] RBAC: Adding query filter params (role.id=a10baa216e4941ad8d168a1f7825a966, scope.project.id=fb66039441c14b96a79a30de4a833fa2, user.id=cb10c682def54ce9a22445a9b880d8ad) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:27.911508 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dcd20d-0ad9-4d94-b362-ef91a01c7b7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:27.913279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dcd20d-0ad9-4d94-b362-ef91a01c7b7f None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:27.930606 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 264/524] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:14:27 2022] GET /identity/v3/role_assignments?user.id=cb10c682def54ce9a22445a9b880d8ad&scope.project.id=fb66039441c14b96a79a30de4a833fa2&role.id=a10baa216e4941ad8d168a1f7825a966 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:27.930606 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcd20d-0ad9-4d94-b362-ef91a01c7b7f None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:28.046268 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:28.052427 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf017f-f972-4dd4-a7f4-0b9c4d09d708 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:28.057616 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcd20d-0ad9-4d94-b362-ef91a01c7b7f None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:28.094747 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cb1dc-2d1d-4c6f-b5a5-241bd21f42e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:28.095594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cb1dc-2d1d-4c6f-b5a5-241bd21f42e4 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:28.095963 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cb1dc-2d1d-4c6f-b5a5-241bd21f42e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:28.096323 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cb1dc-2d1d-4c6f-b5a5-241bd21f42e4 None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:28.097142 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cb1dc-2d1d-4c6f-b5a5-241bd21f42e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:28.097540 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cb1dc-2d1d-4c6f-b5a5-241bd21f42e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:28.099076 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cb1dc-2d1d-4c6f-b5a5-241bd21f42e4 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:28.099610 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba4d76-83ae-42b1-a7ec-36ef0e582656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:28.100977 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba4d76-83ae-42b1-a7ec-36ef0e582656 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:28.101640 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba4d76-83ae-42b1-a7ec-36ef0e582656 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:28.102144 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba4d76-83ae-42b1-a7ec-36ef0e582656 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:28.112179 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba4d76-83ae-42b1-a7ec-36ef0e582656 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:28.113714 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 265/525] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:28.114185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba4d76-83ae-42b1-a7ec-36ef0e582656 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:28.119498 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cb1dc-2d1d-4c6f-b5a5-241bd21f42e4 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:28.133611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-e6ba4d76-83ae-42b1-a7ec-36ef0e582656 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:28.133611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:28.133611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:28.133611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:28.133611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:28.133611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:28.133611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:28.133611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:28.133611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:28.133611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:28.133611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:28.133611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:28.133611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 17:14:28.133611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 17:14:28.133611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 17:14:28.134520 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 17:14:28.134520 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:28.134520 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:28.134520 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:28.134520 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:28.134520 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:28.134520 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:28.134520 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:28.134520 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:28.134520 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:28.134520 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:28.134520 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:28.134520 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:28.134520 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:28.134520 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:28.134520 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:28.134520 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:28.136715 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 17:14:28.136715 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 17:14:28.136715 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 17:14:28.136715 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 17:14:28.136715 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 17:14:28.136715 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 17:14:28.136715 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:28.136715 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:28.136715 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 261/526] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:28.143162 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba4d76-83ae-42b1-a7ec-36ef0e582656 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:28.202661 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:28.253605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cb1dc-2d1d-4c6f-b5a5-241bd21f42e4 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:28.256447 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba4d76-83ae-42b1-a7ec-36ef0e582656 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:28.298598 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5eafb5-bcc8-43a9-9e98-74e404fa09ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:28.299656 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5eafb5-bcc8-43a9-9e98-74e404fa09ed None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:28.299656 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5eafb5-bcc8-43a9-9e98-74e404fa09ed None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:28.300379 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5eafb5-bcc8-43a9-9e98-74e404fa09ed None admin] PATH_INFO: `/v3/projects` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:28.300867 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5eafb5-bcc8-43a9-9e98-74e404fa09ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:28.301524 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5eafb5-bcc8-43a9-9e98-74e404fa09ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:28.302361 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb5350-84a1-446a-8902-6e1406d5c3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:28.302807 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5eafb5-bcc8-43a9-9e98-74e404fa09ed None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:28.303896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb5350-84a1-446a-8902-6e1406d5c3e4 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:28.304395 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb5350-84a1-446a-8902-6e1406d5c3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:28.304948 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb5350-84a1-446a-8902-6e1406d5c3e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:28.313107 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb5350-84a1-446a-8902-6e1406d5c3e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:28.314553 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb5350-84a1-446a-8902-6e1406d5c3e4 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:28.323834 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 262/527] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 24 17:14:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:28.331564 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5eafb5-bcc8-43a9-9e98-74e404fa09ed None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:28.334044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-b6cb5350-84a1-446a-8902-6e1406d5c3e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:28.334044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:28.334044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:28.334044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:28.334044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:28.334044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:28.334044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:28.334044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:28.334044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:28.334044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:28.334044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:28.334044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:28.334044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 17:14:28.334044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 17:14:28.334044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 17:14:28.334941 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 17:14:28.334941 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:28.334941 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:28.334941 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:28.334941 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:28.334941 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:28.334941 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:28.334941 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:28.334941 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:28.334941 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:28.334941 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:28.334941 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:28.334941 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:28.334941 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:28.334941 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:28.334941 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:28.334941 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:28.335781 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 17:14:28.335781 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 17:14:28.335781 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 17:14:28.335781 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 17:14:28.335781 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 17:14:28.335781 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 17:14:28.335781 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:28.335781 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:28.342692 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 266/528] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:28.343829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb5350-84a1-446a-8902-6e1406d5c3e4 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:28.360601 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:28.452779 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5eafb5-bcc8-43a9-9e98-74e404fa09ed None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:28.460602 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb5350-84a1-446a-8902-6e1406d5c3e4 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:28.469712 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:28.493132 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112b60d-f08e-4514-a78d-951ec56aa7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:28.493813 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112b60d-f08e-4514-a78d-951ec56aa7b2 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:28.494132 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112b60d-f08e-4514-a78d-951ec56aa7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:28.494345 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112b60d-f08e-4514-a78d-951ec56aa7b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:28.495198 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112b60d-f08e-4514-a78d-951ec56aa7b2 None admin] RBAC: Adding query filter params (role.id=a10baa216e4941ad8d168a1f7825a966, scope.project.id=fb66039441c14b96a79a30de4a833fa2, user.id=aa7e8d98fb4744b7af95aa93050318d4) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:28.495500 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112b60d-f08e-4514-a78d-951ec56aa7b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:28.497153 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112b60d-f08e-4514-a78d-951ec56aa7b2 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:28.510596 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 263/529] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:14:28 2022] GET /identity/v3/role_assignments?user.id=aa7e8d98fb4744b7af95aa93050318d4&scope.project.id=fb66039441c14b96a79a30de4a833fa2&role.id=a10baa216e4941ad8d168a1f7825a966 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:28.510797 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea84a4-cf4d-4d2b-8784-7f52e0253c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:28.510797 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea84a4-cf4d-4d2b-8784-7f52e0253c7a None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:28.510797 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea84a4-cf4d-4d2b-8784-7f52e0253c7a None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:28.510797 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea84a4-cf4d-4d2b-8784-7f52e0253c7a None admin] PATH_INFO: `/v3/projects` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:28.511078 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea84a4-cf4d-4d2b-8784-7f52e0253c7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:28.511373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea84a4-cf4d-4d2b-8784-7f52e0253c7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:28.512830 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea84a4-cf4d-4d2b-8784-7f52e0253c7a None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:28.527416 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 267/530] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 24 17:14:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:28.535788 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112b60d-f08e-4514-a78d-951ec56aa7b2 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:28.645083 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112b60d-f08e-4514-a78d-951ec56aa7b2 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:28.685662 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9b5f8-9970-4899-85d1-c1ea9c67a57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:28.686750 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9b5f8-9970-4899-85d1-c1ea9c67a57c None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:28.687221 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9b5f8-9970-4899-85d1-c1ea9c67a57c None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:28.687703 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9b5f8-9970-4899-85d1-c1ea9c67a57c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:28.688759 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9b5f8-9970-4899-85d1-c1ea9c67a57c None admin] RBAC: Adding query filter params (role.id=a10baa216e4941ad8d168a1f7825a966, scope.project.id=fb66039441c14b96a79a30de4a833fa2, user.id=f6385ebfadc74598b3b024408455842e) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:28.689373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9b5f8-9970-4899-85d1-c1ea9c67a57c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:28.691088 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9b5f8-9970-4899-85d1-c1ea9c67a57c None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:28.698233 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 264/531] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:14:28 2022] GET /identity/v3/role_assignments?user.id=f6385ebfadc74598b3b024408455842e&scope.project.id=fb66039441c14b96a79a30de4a833fa2&role.id=a10baa216e4941ad8d168a1f7825a966 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:30.078623 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af0fc6-0934-4b77-b18c-69166cc43804 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:30.079151 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af0fc6-0934-4b77-b18c-69166cc43804 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:30.079151 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af0fc6-0934-4b77-b18c-69166cc43804 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:30.080868 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 268/532] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:30.087167 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ba2ad-a413-4689-84db-079007129b1a None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:30.087720 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ba2ad-a413-4689-84db-079007129b1a None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:30.087720 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ba2ad-a413-4689-84db-079007129b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:30.105482 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-dd8ba2ad-a413-4689-84db-079007129b1a None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:30.106700 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-dd8ba2ad-a413-4689-84db-079007129b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:30.141997 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:30.174527 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 265/533] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:30.197627 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af0fc6-0934-4b77-b18c-69166cc43804 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:30.271071 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:30.309526 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af0fc6-0934-4b77-b18c-69166cc43804 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:30.328962 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745122-93c9-43fe-a690-86ae358cb289 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:30.329240 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745122-93c9-43fe-a690-86ae358cb289 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:30.329511 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745122-93c9-43fe-a690-86ae358cb289 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:30.331445 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 266/534] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:30.337910 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3516c0-0cfd-42e1-a927-7267e734f1db None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:30.338189 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3516c0-0cfd-42e1-a927-7267e734f1db None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:30.338459 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3516c0-0cfd-42e1-a927-7267e734f1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:30.349026 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bfaa7-8d00-4fac-9061-3b6e8150ffa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:30.350762 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bfaa7-8d00-4fac-9061-3b6e8150ffa8 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:30.351447 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bfaa7-8d00-4fac-9061-3b6e8150ffa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:30.351916 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bfaa7-8d00-4fac-9061-3b6e8150ffa8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:30.359845 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-fb3516c0-0cfd-42e1-a927-7267e734f1db None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:30.361368 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-fb3516c0-0cfd-42e1-a927-7267e734f1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:30.363504 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bfaa7-8d00-4fac-9061-3b6e8150ffa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:30.371786 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-6a8bfaa7-8d00-4fac-9061-3b6e8150ffa8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:30.371786 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:30.371786 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:30.371786 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:30.371786 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:30.371786 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:30.371786 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:30.371786 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:30.371786 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:30.371786 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:30.371786 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:30.371786 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:30.371786 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:30.371786 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:30.371786 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:30.371786 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:30.372680 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:30.372680 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:30.372680 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:30.372680 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:30.372680 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:30.372680 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:30.372680 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:30.372680 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:30.372680 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:30.372680 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:30.372680 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:30.372680 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:30.372680 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:30.372680 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:30.372680 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:30.372680 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:30.373462 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:30.373462 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:30.373462 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:30.373462 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:30.373462 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:30.373462 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:30.373462 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:30.373462 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:30.373462 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:30.373462 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:30.373462 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:30.373462 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:30.376233 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 269/535] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 24 17:14:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:30.381845 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bfaa7-8d00-4fac-9061-3b6e8150ffa8 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:30.442889 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 267/536] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 17:14:30.460868 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3516c0-0cfd-42e1-a927-7267e734f1db None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:30.510760 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bfaa7-8d00-4fac-9061-3b6e8150ffa8 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:30.547603 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390c1cf-b78a-40aa-a96e-9f430135fa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:30.548293 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390c1cf-b78a-40aa-a96e-9f430135fa8d None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:30.548558 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390c1cf-b78a-40aa-a96e-9f430135fa8d None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:30.548830 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390c1cf-b78a-40aa-a96e-9f430135fa8d None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:30.549603 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390c1cf-b78a-40aa-a96e-9f430135fa8d None admin] RBAC: Adding query filter params (name=service) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:30.550297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390c1cf-b78a-40aa-a96e-9f430135fa8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:30.551268 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390c1cf-b78a-40aa-a96e-9f430135fa8d None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:30.557803 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:30.566052 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 270/537] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 24 17:14:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:30.572795 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390c1cf-b78a-40aa-a96e-9f430135fa8d None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:30.585966 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3516c0-0cfd-42e1-a927-7267e734f1db None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:30.588435 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:30.632474 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02ce4d-e9d8-4990-b9af-5b22e016cc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:30.634201 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02ce4d-e9d8-4990-b9af-5b22e016cc73 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:30.634982 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02ce4d-e9d8-4990-b9af-5b22e016cc73 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:30.635402 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02ce4d-e9d8-4990-b9af-5b22e016cc73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:30.651417 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02ce4d-e9d8-4990-b9af-5b22e016cc73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:30.661531 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-4d02ce4d-e9d8-4990-b9af-5b22e016cc73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:30.661531 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:30.661531 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:30.661531 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:30.661531 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:30.661531 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:30.661531 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:30.661531 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:30.661531 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:30.661531 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:30.661531 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:30.661531 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:30.661531 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:30.661531 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:30.661531 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:30.661531 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:30.662775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:30.662775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:30.662775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:30.662775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:30.662775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:30.662775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:30.662775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:30.662775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:30.662775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:30.662775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:30.662775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:30.662775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:30.662775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:30.662775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:30.662775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:30.662775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:30.663720 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:30.663720 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:30.663720 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:30.663720 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:30.663720 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:30.663720 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:30.663720 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:30.663720 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:30.663720 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:30.663720 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:30.663720 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:30.663720 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:30.667014 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 268/538] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 24 17:14:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:14:30.672313 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02ce4d-e9d8-4990-b9af-5b22e016cc73 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:30.697451 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390c1cf-b78a-40aa-a96e-9f430135fa8d None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:30.744947 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819704cb-06a5-4847-8e9b-6d824cfb1428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:30.746148 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819704cb-06a5-4847-8e9b-6d824cfb1428 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:30.747336 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819704cb-06a5-4847-8e9b-6d824cfb1428 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:30.747765 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819704cb-06a5-4847-8e9b-6d824cfb1428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:30.761274 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819704cb-06a5-4847-8e9b-6d824cfb1428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:30.763345 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819704cb-06a5-4847-8e9b-6d824cfb1428 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:30.780941 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02ce4d-e9d8-4990-b9af-5b22e016cc73 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:30.781658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-819704cb-06a5-4847-8e9b-6d824cfb1428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:30.781658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:30.781658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:30.781658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:30.781658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:30.781658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:30.781658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:30.781658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:30.781658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:30.781658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:30.781658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:30.781658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:30.781658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:30.781658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:30.781658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:30.782489 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:30.782489 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:30.782489 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:30.782489 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:30.782489 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:30.782489 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:30.782489 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:30.782489 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:30.782489 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:30.782489 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:30.782489 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:30.782489 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:30.782489 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:30.782489 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:30.782489 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:30.782489 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:30.782489 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:30.783632 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:30.783632 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:30.783632 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:30.783632 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:30.786946 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 271/539] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:14:30.788828 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819704cb-06a5-4847-8e9b-6d824cfb1428 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:30.832949 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e001571-1633-4757-81c1-16c2e06a0bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:30.834009 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e001571-1633-4757-81c1-16c2e06a0bbb None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:30.834507 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e001571-1633-4757-81c1-16c2e06a0bbb None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:30.835011 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e001571-1633-4757-81c1-16c2e06a0bbb None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:30.835973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e001571-1633-4757-81c1-16c2e06a0bbb None admin] RBAC: Adding query filter params (name=service) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:30.836478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e001571-1633-4757-81c1-16c2e06a0bbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:30.838892 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e001571-1633-4757-81c1-16c2e06a0bbb None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:30.848157 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:30.852084 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 269/540] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 24 17:14:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:30.857117 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e001571-1633-4757-81c1-16c2e06a0bbb None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:30.885506 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:30.913638 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819704cb-06a5-4847-8e9b-6d824cfb1428 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:30.955169 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf697a-a890-4fca-ba2d-b4cf99a28722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:30.955826 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf697a-a890-4fca-ba2d-b4cf99a28722 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:30.956175 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf697a-a890-4fca-ba2d-b4cf99a28722 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:30.956445 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf697a-a890-4fca-ba2d-b4cf99a28722 None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:30.957069 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf697a-a890-4fca-ba2d-b4cf99a28722 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:30.957360 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf697a-a890-4fca-ba2d-b4cf99a28722 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:30.958751 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf697a-a890-4fca-ba2d-b4cf99a28722 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:30.964236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e001571-1633-4757-81c1-16c2e06a0bbb None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:30.975607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 272/541] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:30.975607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03174f78-cdee-4487-8e08-bc25d5e92b5c None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:30.975607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03174f78-cdee-4487-8e08-bc25d5e92b5c None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:30.975607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03174f78-cdee-4487-8e08-bc25d5e92b5c None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:30.978319 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 273/542] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:30.979132 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03174f78-cdee-4487-8e08-bc25d5e92b5c None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:31.005285 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219bb6f-5ce6-45d6-a065-b8ec553c76ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:31.006106 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219bb6f-5ce6-45d6-a065-b8ec553c76ad None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:31.006385 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219bb6f-5ce6-45d6-a065-b8ec553c76ad None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:31.006685 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219bb6f-5ce6-45d6-a065-b8ec553c76ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:31.018226 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219bb6f-5ce6-45d6-a065-b8ec553c76ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:31.019723 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219bb6f-5ce6-45d6-a065-b8ec553c76ad None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:31.040270 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-5219bb6f-5ce6-45d6-a065-b8ec553c76ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:31.040270 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:31.040270 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:31.040270 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:31.040270 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:31.040270 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:31.040270 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:31.040270 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:31.040270 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:31.040270 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:31.040270 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:31.040270 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:31.040270 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:31.040270 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:31.040270 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:31.041168 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:31.041168 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:31.041168 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:31.041168 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:31.041168 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:31.041168 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:31.041168 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:31.041168 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:31.041168 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:31.041168 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:31.041168 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:31.041168 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:31.041168 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:31.041168 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:31.041168 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:31.041168 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:31.041168 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:31.046428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:31.046428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:31.046428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:31.046428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:31.046428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 270/543] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:31.046428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f728e7-d859-40e7-9ecf-31eb168b5a7d None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:31.046428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f728e7-d859-40e7-9ecf-31eb168b5a7d None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:31.046428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f728e7-d859-40e7-9ecf-31eb168b5a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:31.061459 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-07f728e7-d859-40e7-9ecf-31eb168b5a7d None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:31.062680 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-07f728e7-d859-40e7-9ecf-31eb168b5a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:31.086924 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03174f78-cdee-4487-8e08-bc25d5e92b5c None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:31.094006 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:31.124172 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c638ea-f419-4a44-baaa-4e0a9a0abbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:31.124958 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c638ea-f419-4a44-baaa-4e0a9a0abbbe None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:31.125236 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c638ea-f419-4a44-baaa-4e0a9a0abbbe None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:31.125501 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c638ea-f419-4a44-baaa-4e0a9a0abbbe None admin] PATH_INFO: `/v3/users/nova` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:31.127241 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 271/544] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:31.128558 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ebf32-fa65-4187-bbef-8f3a29cb7e6d None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:31.128833 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ebf32-fa65-4187-bbef-8f3a29cb7e6d None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:31.129105 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ebf32-fa65-4187-bbef-8f3a29cb7e6d None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:31.130315 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 272/545] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:31.131033 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ebf32-fa65-4187-bbef-8f3a29cb7e6d None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:31.140463 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:31.140621 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c638ea-f419-4a44-baaa-4e0a9a0abbbe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:31.142051 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c638ea-f419-4a44-baaa-4e0a9a0abbbe None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:31.162358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-f9c638ea-f419-4a44-baaa-4e0a9a0abbbe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 17:14:31.162358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:31.162358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:31.162358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:31.162358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:31.162358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:31.162358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:31.162358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:31.162358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:31.162358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:31.162358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:31.162358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:31.162358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 17:14:31.162358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 17:14:31.162358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 17:14:31.162358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 17:14:31.163584 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:31.163584 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:31.163584 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 17:14:31.163584 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:31.163584 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 17:14:31.163584 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:31.163584 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:31.163584 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:31.163584 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:31.163584 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:31.163584 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:31.163584 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:31.163584 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:31.163584 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:31.163584 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:31.163584 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:31.163584 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:31.163584 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:31.164487 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:31.164487 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:31.164487 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 17:14:31.164487 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 17:14:31.164487 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 17:14:31.164487 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 17:14:31.164487 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 17:14:31.164487 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 17:14:31.164487 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 17:14:31.164487 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:31.164487 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 274/546] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Jun 24 17:14:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:31.165627 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e02986-bc17-4fb9-9968-ec2b282f5cd1 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:31.165911 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e02986-bc17-4fb9-9968-ec2b282f5cd1 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:31.166179 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e02986-bc17-4fb9-9968-ec2b282f5cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:31.183742 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-50e02986-bc17-4fb9-9968-ec2b282f5cd1 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:31.184979 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-50e02986-bc17-4fb9-9968-ec2b282f5cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:31.240832 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ebf32-fa65-4187-bbef-8f3a29cb7e6d None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:31.258090 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 275/547] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:31.259021 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e02986-bc17-4fb9-9968-ec2b282f5cd1 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:31.275624 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e8438-9e19-412f-bab2-3dc6f30db40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:31.276496 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e8438-9e19-412f-bab2-3dc6f30db40d None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:31.276829 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e8438-9e19-412f-bab2-3dc6f30db40d None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:31.277148 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e8438-9e19-412f-bab2-3dc6f30db40d None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:31.277948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e8438-9e19-412f-bab2-3dc6f30db40d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:31.278458 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e8438-9e19-412f-bab2-3dc6f30db40d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:31.279744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e8438-9e19-412f-bab2-3dc6f30db40d None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:31.291466 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 273/548] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:31.292334 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e8438-9e19-412f-bab2-3dc6f30db40d None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:31.355662 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:31.357273 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:31.361804 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e02986-bc17-4fb9-9968-ec2b282f5cd1 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:31.392888 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e8438-9e19-412f-bab2-3dc6f30db40d None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:31.397616 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c21284-0ed3-4d72-bc03-6c5af4b266d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:31.398448 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c21284-0ed3-4d72-bc03-6c5af4b266d6 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:31.398792 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c21284-0ed3-4d72-bc03-6c5af4b266d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:31.399098 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c21284-0ed3-4d72-bc03-6c5af4b266d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:31.409981 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c21284-0ed3-4d72-bc03-6c5af4b266d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:31.417886 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-41c21284-0ed3-4d72-bc03-6c5af4b266d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:31.417886 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:31.417886 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:31.417886 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:31.417886 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:31.417886 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:31.417886 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:31.417886 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:31.417886 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:31.417886 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:31.417886 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:31.417886 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:31.417886 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:31.417886 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:31.417886 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:31.417886 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:31.418836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:31.418836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:31.418836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:31.418836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:31.418836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:31.418836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:31.418836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:31.418836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:31.418836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:31.418836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:31.418836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:31.418836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:31.418836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:31.418836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:31.418836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:31.418836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:31.419635 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:31.419635 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:31.419635 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:31.419635 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:31.419635 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:31.419635 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:31.419635 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:31.419635 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:31.419635 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:31.419635 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:31.419635 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:31.419635 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:31.419635 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 276/549] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 24 17:14:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:31.420314 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c21284-0ed3-4d72-bc03-6c5af4b266d6 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:31.431995 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61203dc4-1484-4f51-a492-05b61f58aa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:31.432725 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61203dc4-1484-4f51-a492-05b61f58aa00 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:31.433001 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61203dc4-1484-4f51-a492-05b61f58aa00 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:31.433276 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61203dc4-1484-4f51-a492-05b61f58aa00 None admin] PATH_INFO: `/v3/users` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:31.434168 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61203dc4-1484-4f51-a492-05b61f58aa00 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:31.434514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61203dc4-1484-4f51-a492-05b61f58aa00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:31.436021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61203dc4-1484-4f51-a492-05b61f58aa00 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:31.454672 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 274/550] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Jun 24 17:14:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:31.455487 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61203dc4-1484-4f51-a492-05b61f58aa00 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:31.525859 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c21284-0ed3-4d72-bc03-6c5af4b266d6 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:31.557060 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61203dc4-1484-4f51-a492-05b61f58aa00 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:31.560909 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5eab6-9d84-4cb8-843d-ef86709b104e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:31.561761 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5eab6-9d84-4cb8-843d-ef86709b104e None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:31.562082 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5eab6-9d84-4cb8-843d-ef86709b104e None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:31.562397 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5eab6-9d84-4cb8-843d-ef86709b104e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:31.573512 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5eab6-9d84-4cb8-843d-ef86709b104e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:31.580784 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:31.581289 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-f3c5eab6-9d84-4cb8-843d-ef86709b104e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:31.581289 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:31.581289 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:31.581289 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:31.581289 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:31.581289 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:31.581289 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:31.581289 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:31.581289 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:31.581289 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:31.581289 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:31.581289 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:31.581289 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:31.581289 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:31.581289 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:31.581289 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:31.582136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:31.582136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:31.582136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:31.582136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:31.582136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:31.582136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:31.582136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:31.582136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:31.582136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:31.582136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:31.582136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:31.582136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:31.582136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:31.582136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:31.582136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:31.582136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:31.583245 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:31.583245 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:31.583245 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:31.583245 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:31.583245 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:31.583245 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:31.583245 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:31.583245 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:31.583245 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:31.583245 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:31.583245 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:31.583245 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:31.583245 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 277/551] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 24 17:14:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:31.584866 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5eab6-9d84-4cb8-843d-ef86709b104e None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:31.596292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c7ec9-6958-41b3-a28c-806bac00fd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:31.597090 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c7ec9-6958-41b3-a28c-806bac00fd4e None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:31.597364 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c7ec9-6958-41b3-a28c-806bac00fd4e None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:31.597640 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c7ec9-6958-41b3-a28c-806bac00fd4e None admin] PATH_INFO: `/v3/users/glance` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:31.604411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:31.605339 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c7ec9-6958-41b3-a28c-806bac00fd4e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:31.607004 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c7ec9-6958-41b3-a28c-806bac00fd4e None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:31.625526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-7b2c7ec9-6958-41b3-a28c-806bac00fd4e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 17:14:31.625526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:31.625526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:31.625526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:31.625526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:31.625526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:31.625526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:31.625526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:31.625526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:31.625526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:31.625526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:31.625526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:31.625526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 17:14:31.625526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 17:14:31.625526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 17:14:31.625526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 17:14:31.626764 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:31.626764 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:31.626764 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 17:14:31.626764 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:31.626764 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 17:14:31.626764 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:31.626764 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:31.626764 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:31.626764 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:31.626764 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:31.626764 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:31.626764 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:31.626764 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:31.626764 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:31.626764 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:31.626764 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:31.626764 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:31.626764 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:31.627648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:31.627648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:31.627648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 17:14:31.627648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 17:14:31.627648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 17:14:31.627648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 17:14:31.627648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 17:14:31.627648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 17:14:31.627648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 17:14:31.627648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:31.627648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 275/552] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:14:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:31.628230 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c7ec9-6958-41b3-a28c-806bac00fd4e None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:31.690300 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5eab6-9d84-4cb8-843d-ef86709b104e None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:31.724037 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad8462-029f-464e-86ba-4a810d459d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:31.724765 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad8462-029f-464e-86ba-4a810d459d43 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:31.725430 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad8462-029f-464e-86ba-4a810d459d43 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:31.725729 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad8462-029f-464e-86ba-4a810d459d43 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:31.726516 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad8462-029f-464e-86ba-4a810d459d43 None admin] RBAC: Adding query filter params (name=service) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:31.726635 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c7ec9-6958-41b3-a28c-806bac00fd4e None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:31.726888 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad8462-029f-464e-86ba-4a810d459d43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:31.728292 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad8462-029f-464e-86ba-4a810d459d43 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:31.736399 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 278/553] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 24 17:14:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:31.737232 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad8462-029f-464e-86ba-4a810d459d43 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:31.760985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746ec42-0b51-4c6c-8e8a-4fc821969abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:31.761773 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746ec42-0b51-4c6c-8e8a-4fc821969abd None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:31.762031 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746ec42-0b51-4c6c-8e8a-4fc821969abd None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:31.762300 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746ec42-0b51-4c6c-8e8a-4fc821969abd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:31.772521 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746ec42-0b51-4c6c-8e8a-4fc821969abd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:31.773970 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746ec42-0b51-4c6c-8e8a-4fc821969abd None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:31.792358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-9746ec42-0b51-4c6c-8e8a-4fc821969abd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:31.792358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:31.792358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:31.792358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:31.792358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:31.792358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:31.792358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:31.792358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:31.792358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:31.792358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:31.792358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:31.792358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:31.792358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:31.792358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:31.792358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:31.793337 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:31.793337 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:31.793337 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:31.793337 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:31.793337 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:31.793337 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:31.793337 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:31.793337 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:31.793337 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:31.793337 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:31.793337 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:31.793337 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:31.793337 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:31.793337 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:31.793337 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:31.793337 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:31.793337 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:31.794180 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:31.794180 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:31.794180 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:31.794180 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:31.794180 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 276/554] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:31.794488 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746ec42-0b51-4c6c-8e8a-4fc821969abd None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:31.823177 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:31.828181 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:31.845996 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad8462-029f-464e-86ba-4a810d459d43 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:31.880628 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfb1e3-2912-4885-820c-6dad45c8435a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:31.881284 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfb1e3-2912-4885-820c-6dad45c8435a None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:31.881603 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfb1e3-2912-4885-820c-6dad45c8435a None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:31.881920 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfb1e3-2912-4885-820c-6dad45c8435a None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:31.882738 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfb1e3-2912-4885-820c-6dad45c8435a None admin] RBAC: Adding query filter params (name=service) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:31.883069 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfb1e3-2912-4885-820c-6dad45c8435a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:31.884480 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfb1e3-2912-4885-820c-6dad45c8435a None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:31.892684 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 279/555] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 24 17:14:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:31.892831 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746ec42-0b51-4c6c-8e8a-4fc821969abd None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:31.895490 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfb1e3-2912-4885-820c-6dad45c8435a None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:31.927846 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f82fa9-b301-493b-be95-fa633ae97af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:31.928502 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f82fa9-b301-493b-be95-fa633ae97af3 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:31.928777 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f82fa9-b301-493b-be95-fa633ae97af3 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:31.929051 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f82fa9-b301-493b-be95-fa633ae97af3 None admin] PATH_INFO: `/v3/users` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:31.929882 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f82fa9-b301-493b-be95-fa633ae97af3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:31.930184 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f82fa9-b301-493b-be95-fa633ae97af3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:31.931659 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f82fa9-b301-493b-be95-fa633ae97af3 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:31.949620 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 277/556] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Jun 24 17:14:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:31.950450 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f82fa9-b301-493b-be95-fa633ae97af3 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:32.002012 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfb1e3-2912-4885-820c-6dad45c8435a None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:32.036421 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a5ce8-d4f7-44ee-a9f3-d1afd9cc93ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:32.037300 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a5ce8-d4f7-44ee-a9f3-d1afd9cc93ce None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:32.037616 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a5ce8-d4f7-44ee-a9f3-d1afd9cc93ce None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:32.037926 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a5ce8-d4f7-44ee-a9f3-d1afd9cc93ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:32.044564 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:32.047321 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:32.049667 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a5ce8-d4f7-44ee-a9f3-d1afd9cc93ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:32.051555 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a5ce8-d4f7-44ee-a9f3-d1afd9cc93ce None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:32.051821 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f82fa9-b301-493b-be95-fa633ae97af3 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:32.069035 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-068a5ce8-d4f7-44ee-a9f3-d1afd9cc93ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:32.069035 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:32.069035 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:32.069035 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:32.069035 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:32.069035 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:32.069035 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:32.069035 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:32.069035 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:32.069035 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:32.069035 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:32.069035 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:32.069035 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:32.069035 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:32.069035 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:32.069962 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:32.069962 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:32.069962 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:32.069962 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:32.069962 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:32.069962 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:32.069962 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:32.069962 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:32.069962 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:32.069962 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:32.069962 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:32.069962 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:32.069962 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:32.069962 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:32.069962 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:32.069962 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:32.069962 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:32.070856 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:32.070856 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:32.070856 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:32.070856 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:32.070856 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 280/557] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:32.071138 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a5ce8-d4f7-44ee-a9f3-d1afd9cc93ce None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:32.085502 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a370e-da3f-4ce3-b786-4d3e30714813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:32.086160 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a370e-da3f-4ce3-b786-4d3e30714813 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:32.086433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a370e-da3f-4ce3-b786-4d3e30714813 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:32.086739 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a370e-da3f-4ce3-b786-4d3e30714813 None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:32.087451 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a370e-da3f-4ce3-b786-4d3e30714813 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:32.087745 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a370e-da3f-4ce3-b786-4d3e30714813 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:32.089114 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a370e-da3f-4ce3-b786-4d3e30714813 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:32.100521 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 278/558] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:32.101304 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a370e-da3f-4ce3-b786-4d3e30714813 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:32.174168 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a5ce8-d4f7-44ee-a9f3-d1afd9cc93ce None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:32.213029 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61208d9c-4165-4e5b-acc8-4db5938662e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:32.214120 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61208d9c-4165-4e5b-acc8-4db5938662e0 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:32.214446 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61208d9c-4165-4e5b-acc8-4db5938662e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:32.214771 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61208d9c-4165-4e5b-acc8-4db5938662e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:32.228142 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61208d9c-4165-4e5b-acc8-4db5938662e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:32.229651 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61208d9c-4165-4e5b-acc8-4db5938662e0 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:32.248933 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-61208d9c-4165-4e5b-acc8-4db5938662e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:32.248933 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:32.248933 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:32.248933 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:32.248933 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:32.248933 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:32.248933 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:32.248933 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:32.248933 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:32.248933 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:32.248933 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:32.248933 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:32.248933 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:32.248933 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:32.248933 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:32.250367 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:32.250367 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:32.250367 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:32.250367 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:32.250367 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:32.250367 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:32.250367 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:32.250367 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:32.250367 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:32.250367 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:32.250367 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:32.250367 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:32.250367 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:32.250367 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:32.250367 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:32.250367 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:32.250367 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:32.251764 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:32.251764 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:32.251764 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:32.251764 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:32.251764 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 281/559] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:32.251764 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61208d9c-4165-4e5b-acc8-4db5938662e0 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:32.312861 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:32.341960 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a370e-da3f-4ce3-b786-4d3e30714813 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:32.372568 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61208d9c-4165-4e5b-acc8-4db5938662e0 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:32.377353 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65960c99-b214-40e7-8957-656798b922dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:32.378171 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65960c99-b214-40e7-8957-656798b922dc None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:32.378448 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65960c99-b214-40e7-8957-656798b922dc None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:32.378742 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65960c99-b214-40e7-8957-656798b922dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:32.388769 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65960c99-b214-40e7-8957-656798b922dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:32.390225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65960c99-b214-40e7-8957-656798b922dc None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:32.407227 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-65960c99-b214-40e7-8957-656798b922dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:32.407227 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:32.407227 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:32.407227 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:32.407227 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:32.407227 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:32.407227 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:32.407227 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:32.407227 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:32.407227 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:32.407227 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:32.407227 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:32.407227 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:32.407227 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:32.407227 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:32.408236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:32.408236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:32.408236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:32.408236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:32.408236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:32.408236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:32.408236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:32.408236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:32.408236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:32.408236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:32.408236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:32.408236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:32.408236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:32.408236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:32.408236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:32.408236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:32.408236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:32.409259 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:32.409259 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:32.409259 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:32.409259 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:32.409259 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 279/560] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:32.409610 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65960c99-b214-40e7-8957-656798b922dc None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:32.412252 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa73149-9ffb-4658-9534-36026c16743a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:32.413219 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa73149-9ffb-4658-9534-36026c16743a None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:32.413334 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa73149-9ffb-4658-9534-36026c16743a None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:32.413646 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa73149-9ffb-4658-9534-36026c16743a None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:32.414410 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa73149-9ffb-4658-9534-36026c16743a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:32.414776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa73149-9ffb-4658-9534-36026c16743a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:32.416173 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa73149-9ffb-4658-9534-36026c16743a None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:32.419352 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:32.429135 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 282/561] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:32.429934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa73149-9ffb-4658-9534-36026c16743a None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:32.514852 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65960c99-b214-40e7-8957-656798b922dc None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:32.533586 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa73149-9ffb-4658-9534-36026c16743a None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:32.536010 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:32.548492 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d98c63-8cae-4283-912c-a2ac4b6af011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:32.549450 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d98c63-8cae-4283-912c-a2ac4b6af011 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:32.549773 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d98c63-8cae-4283-912c-a2ac4b6af011 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:32.550035 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d98c63-8cae-4283-912c-a2ac4b6af011 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:32.557496 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d98c63-8cae-4283-912c-a2ac4b6af011 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:32.558981 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d98c63-8cae-4283-912c-a2ac4b6af011 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:32.572016 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5c48d-e8e6-48c1-a00f-177ae2d3f717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:32.572732 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5c48d-e8e6-48c1-a00f-177ae2d3f717 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:32.573038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5c48d-e8e6-48c1-a00f-177ae2d3f717 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:32.573135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-25d98c63-8cae-4283-912c-a2ac4b6af011 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:32.573135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:32.573135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:32.573135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:32.573135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:32.573135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:32.573135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:32.573135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:32.573135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:32.573135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:32.573135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:32.573135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:32.573135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 17:14:32.573135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 17:14:32.573135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 17:14:32.574135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 17:14:32.574135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:32.574135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:32.574135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:32.574135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:32.574135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:32.574135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:32.574135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:32.574135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:32.574135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:32.574135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:32.574135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:32.574135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:32.574135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:32.574135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:32.574135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:32.574135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:32.575483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 17:14:32.575483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 17:14:32.575483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 17:14:32.575483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 17:14:32.575483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 17:14:32.575483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 17:14:32.575483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:32.575483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:32.575987 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5c48d-e8e6-48c1-a00f-177ae2d3f717 None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:32.575987 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5c48d-e8e6-48c1-a00f-177ae2d3f717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:32.576123 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 280/562] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:32.576123 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d98c63-8cae-4283-912c-a2ac4b6af011 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:32.579006 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5c48d-e8e6-48c1-a00f-177ae2d3f717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:32.580453 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5c48d-e8e6-48c1-a00f-177ae2d3f717 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:32.593009 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 283/563] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:32.593848 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5c48d-e8e6-48c1-a00f-177ae2d3f717 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:32.643111 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:32.681242 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d98c63-8cae-4283-912c-a2ac4b6af011 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:32.693094 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5c48d-e8e6-48c1-a00f-177ae2d3f717 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:32.714233 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4071ae-4026-47d1-a442-a12645367227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:32.714921 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4071ae-4026-47d1-a442-a12645367227 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:32.715194 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4071ae-4026-47d1-a442-a12645367227 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:32.715457 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4071ae-4026-47d1-a442-a12645367227 None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:32.716163 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4071ae-4026-47d1-a442-a12645367227 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:32.716464 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4071ae-4026-47d1-a442-a12645367227 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:32.717844 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4071ae-4026-47d1-a442-a12645367227 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:32.729054 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67349e-5109-45b4-b449-846492ddf08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:32.729710 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 281/564] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:32.729921 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67349e-5109-45b4-b449-846492ddf08e None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:32.730207 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67349e-5109-45b4-b449-846492ddf08e None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:32.730504 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4071ae-4026-47d1-a442-a12645367227 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:32.730670 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67349e-5109-45b4-b449-846492ddf08e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:32.741937 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67349e-5109-45b4-b449-846492ddf08e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:32.743477 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67349e-5109-45b4-b449-846492ddf08e None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:32.757829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-2d67349e-5109-45b4-b449-846492ddf08e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 17:14:32.757829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:32.757829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:32.757829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:32.757829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:32.757829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:32.757829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:32.757829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:32.757829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:32.757829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:32.757829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:32.757829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:32.757829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 17:14:32.757829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 17:14:32.757829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 17:14:32.757829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 17:14:32.758814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:32.758814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:32.758814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 17:14:32.758814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:32.758814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 17:14:32.758814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:32.758814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:32.758814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:32.758814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:32.758814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:32.758814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:32.758814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:32.758814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:32.758814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:32.758814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:32.758814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:32.758814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:32.758814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:32.759984 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:32.759984 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:32.759984 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 17:14:32.759984 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 17:14:32.759984 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 17:14:32.759984 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 17:14:32.759984 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 17:14:32.759984 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 17:14:32.759984 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 17:14:32.759984 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:32.759984 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 284/565] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:14:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:32.760891 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67349e-5109-45b4-b449-846492ddf08e None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:32.786397 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:32.834052 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4071ae-4026-47d1-a442-a12645367227 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:32.859986 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:32.865172 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67349e-5109-45b4-b449-846492ddf08e None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:32.870472 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377f952-310a-4aa6-af24-9f6a760bb4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:32.871188 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377f952-310a-4aa6-af24-9f6a760bb4ee None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:32.871469 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377f952-310a-4aa6-af24-9f6a760bb4ee None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:32.871743 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377f952-310a-4aa6-af24-9f6a760bb4ee None admin] PATH_INFO: `/v3/projects` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:32.872527 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377f952-310a-4aa6-af24-9f6a760bb4ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:32.872838 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377f952-310a-4aa6-af24-9f6a760bb4ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:32.874284 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377f952-310a-4aa6-af24-9f6a760bb4ee None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:32.885920 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 282/566] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 24 17:14:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:32.886749 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377f952-310a-4aa6-af24-9f6a760bb4ee None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:32.900482 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca010f02-b2b2-4bf6-8a85-d21dde0b444d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:32.901344 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca010f02-b2b2-4bf6-8a85-d21dde0b444d None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:32.901659 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca010f02-b2b2-4bf6-8a85-d21dde0b444d None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:32.901976 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca010f02-b2b2-4bf6-8a85-d21dde0b444d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:32.909738 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca010f02-b2b2-4bf6-8a85-d21dde0b444d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:32.911254 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca010f02-b2b2-4bf6-8a85-d21dde0b444d None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:32.925707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-ca010f02-b2b2-4bf6-8a85-d21dde0b444d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 17:14:32.925707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:32.925707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:32.925707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:32.925707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:32.925707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:32.925707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:32.925707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:32.925707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:32.925707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:32.925707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:32.925707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:32.925707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 17:14:32.925707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 17:14:32.925707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 17:14:32.925707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 17:14:32.926843 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:32.926843 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:32.926843 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 17:14:32.926843 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:32.926843 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 17:14:32.926843 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:32.926843 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:32.926843 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:32.926843 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:32.926843 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:32.926843 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:32.926843 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:32.926843 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:32.926843 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:32.926843 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:32.926843 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:32.926843 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:32.926843 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:32.927916 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:32.927916 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:32.927916 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 17:14:32.927916 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 17:14:32.927916 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 17:14:32.927916 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 17:14:32.927916 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 17:14:32.927916 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 17:14:32.927916 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 17:14:32.927916 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:32.927916 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 285/567] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 24 17:14:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:32.928497 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca010f02-b2b2-4bf6-8a85-d21dde0b444d None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:32.993083 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377f952-310a-4aa6-af24-9f6a760bb4ee None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:33.019051 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:33.031093 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61a697-5067-4ec1-8953-da3dd9b98cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:33.031892 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61a697-5067-4ec1-8953-da3dd9b98cd8 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:33.032163 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61a697-5067-4ec1-8953-da3dd9b98cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:33.032426 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61a697-5067-4ec1-8953-da3dd9b98cd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:33.036770 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca010f02-b2b2-4bf6-8a85-d21dde0b444d None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:33.039311 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61a697-5067-4ec1-8953-da3dd9b98cd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:33.040805 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61a697-5067-4ec1-8953-da3dd9b98cd8 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:33.054744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-db61a697-5067-4ec1-8953-da3dd9b98cd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:33.054744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:33.054744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:33.054744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:33.054744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:33.054744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:33.054744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:33.054744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:33.054744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:33.054744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:33.054744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:33.054744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:33.054744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 17:14:33.054744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 17:14:33.054744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 17:14:33.055837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 17:14:33.055837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:33.055837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:33.055837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:33.055837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:33.055837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:33.055837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:33.055837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:33.055837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:33.055837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:33.055837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:33.055837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:33.055837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:33.055837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:33.055837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:33.055837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:33.055837 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:33.056843 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 17:14:33.056843 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 17:14:33.056843 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 17:14:33.056843 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 17:14:33.056843 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 17:14:33.056843 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 17:14:33.056843 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:33.056843 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:33.056843 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 283/568] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:33.057336 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61a697-5067-4ec1-8953-da3dd9b98cd8 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:33.078266 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06230c-48aa-4434-99e3-ad43ac11fd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:33.079003 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06230c-48aa-4434-99e3-ad43ac11fd5e None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:33.079326 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06230c-48aa-4434-99e3-ad43ac11fd5e None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:33.079646 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06230c-48aa-4434-99e3-ad43ac11fd5e None admin] PATH_INFO: `/v3/users` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:33.080524 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06230c-48aa-4434-99e3-ad43ac11fd5e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:33.080873 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06230c-48aa-4434-99e3-ad43ac11fd5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:33.082358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06230c-48aa-4434-99e3-ad43ac11fd5e None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:33.100485 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 286/569] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Jun 24 17:14:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:33.101405 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06230c-48aa-4434-99e3-ad43ac11fd5e None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:33.105865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:33.158907 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61a697-5067-4ec1-8953-da3dd9b98cd8 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:33.192589 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9e5db-3c59-442f-b299-0828a197d995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:33.193718 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9e5db-3c59-442f-b299-0828a197d995 None admin] REQUEST_METHOD: `PUT` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:33.193995 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9e5db-3c59-442f-b299-0828a197d995 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:33.194332 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9e5db-3c59-442f-b299-0828a197d995 None admin] PATH_INFO: `/v3/projects/fb66039441c14b96a79a30de4a833fa2/users/9ff8200a750d49b1830c58f279e569c3/roles/a10baa216e4941ad8d168a1f7825a966` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:33.203138 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06230c-48aa-4434-99e3-ad43ac11fd5e None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:33.208771 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9e5db-3c59-442f-b299-0828a197d995 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb66039441c14b96a79a30de4a833fa2, user_id=9ff8200a750d49b1830c58f279e569c3, role_id=a10baa216e4941ad8d168a1f7825a966)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:33.210317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9e5db-3c59-442f-b299-0828a197d995 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:33.224036 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 284/570] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 24 17:14:33 2022] PUT /identity/v3/projects/fb66039441c14b96a79a30de4a833fa2/users/9ff8200a750d49b1830c58f279e569c3/roles/a10baa216e4941ad8d168a1f7825a966 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:14:33.225093 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9e5db-3c59-442f-b299-0828a197d995 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:33.242079 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6570bf0-ad65-4511-90fa-f2f9b5f06704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:33.242862 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6570bf0-ad65-4511-90fa-f2f9b5f06704 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:33.243254 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6570bf0-ad65-4511-90fa-f2f9b5f06704 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:33.243507 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6570bf0-ad65-4511-90fa-f2f9b5f06704 None admin] PATH_INFO: `/v3/users` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:33.244414 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6570bf0-ad65-4511-90fa-f2f9b5f06704 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:33.244764 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6570bf0-ad65-4511-90fa-f2f9b5f06704 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:33.246300 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6570bf0-ad65-4511-90fa-f2f9b5f06704 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:33.263577 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:33.268602 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 287/571] 10.222.0.15 () {56 vars in 1139 bytes} [Fri Jun 24 17:14:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:33.269333 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6570bf0-ad65-4511-90fa-f2f9b5f06704 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:33.356786 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:33.364447 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9e5db-3c59-442f-b299-0828a197d995 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:33.384136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6570bf0-ad65-4511-90fa-f2f9b5f06704 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:33.411228 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ef974-83c6-4034-afd6-a6a49c496f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:33.412076 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ef974-83c6-4034-afd6-a6a49c496f8d None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:33.412508 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ef974-83c6-4034-afd6-a6a49c496f8d None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:33.413092 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ef974-83c6-4034-afd6-a6a49c496f8d None admin] PATH_INFO: `/v3/projects` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:33.415972 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ef974-83c6-4034-afd6-a6a49c496f8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:33.415972 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ef974-83c6-4034-afd6-a6a49c496f8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:33.415972 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ef974-83c6-4034-afd6-a6a49c496f8d None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:33.426373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5feb1-09f6-469d-b7b4-c8228c5e5d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:33.427230 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5feb1-09f6-469d-b7b4-c8228c5e5d71 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:33.427706 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5feb1-09f6-469d-b7b4-c8228c5e5d71 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:33.428026 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5feb1-09f6-469d-b7b4-c8228c5e5d71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:33.431138 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 285/572] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 24 17:14:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:33.432003 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ef974-83c6-4034-afd6-a6a49c496f8d None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:33.439706 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5feb1-09f6-469d-b7b4-c8228c5e5d71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:33.441199 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5feb1-09f6-469d-b7b4-c8228c5e5d71 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:33.459969 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-efd5feb1-09f6-469d-b7b4-c8228c5e5d71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:33.459969 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:33.459969 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:33.459969 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:33.459969 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:33.459969 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:33.459969 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:33.459969 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:33.459969 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:33.459969 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:33.459969 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:33.459969 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:33.459969 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:33.459969 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:33.459969 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:33.461080 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:33.461080 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:33.461080 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:33.461080 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:33.461080 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:33.461080 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:33.461080 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:33.461080 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:33.461080 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:33.461080 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:33.461080 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:33.461080 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:33.461080 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:33.461080 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:33.461080 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:33.461080 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:33.461080 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:33.462142 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:33.462142 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:33.462142 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:33.462142 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:33.463872 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 288/573] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:33.464810 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5feb1-09f6-469d-b7b4-c8228c5e5d71 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:33.526946 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:33.545979 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ef974-83c6-4034-afd6-a6a49c496f8d None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:33.581511 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5feb1-09f6-469d-b7b4-c8228c5e5d71 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:33.583721 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5d602-72ef-4cbb-8580-de180447a4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:33.584527 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5d602-72ef-4cbb-8580-de180447a4ae None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:33.584800 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5d602-72ef-4cbb-8580-de180447a4ae None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:33.585071 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5d602-72ef-4cbb-8580-de180447a4ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:33.596147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5d602-72ef-4cbb-8580-de180447a4ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:33.597599 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5d602-72ef-4cbb-8580-de180447a4ae None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:33.615642 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-c4c5d602-72ef-4cbb-8580-de180447a4ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:33.615642 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:33.615642 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:33.615642 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:33.615642 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:33.615642 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:33.615642 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:33.615642 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:33.615642 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:33.615642 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:33.615642 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:33.615642 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:33.615642 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:33.615642 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:33.615642 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:33.616757 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:33.616757 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:33.616757 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:33.616757 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:33.616757 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:33.616757 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:33.616757 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:33.616757 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:33.616757 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:33.616757 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:33.616757 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:33.616757 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:33.616757 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:33.616757 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:33.616757 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:33.616757 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:33.616757 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:33.617700 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:33.617700 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:33.617700 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:33.617700 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:33.617700 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 286/574] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:33.618025 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5d602-72ef-4cbb-8580-de180447a4ae None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:33.627746 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64586b-c39a-48df-971d-e89cc76f54ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:33.628760 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64586b-c39a-48df-971d-e89cc76f54ed None admin] REQUEST_METHOD: `PUT` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:33.629142 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64586b-c39a-48df-971d-e89cc76f54ed None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:33.629534 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64586b-c39a-48df-971d-e89cc76f54ed None admin] PATH_INFO: `/v3/projects/fb66039441c14b96a79a30de4a833fa2/users/cb10c682def54ce9a22445a9b880d8ad/roles/a10baa216e4941ad8d168a1f7825a966` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:33.630738 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:33.646284 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64586b-c39a-48df-971d-e89cc76f54ed None admin] RBAC: Authorizing `identity:create_grant(project_id=fb66039441c14b96a79a30de4a833fa2, user_id=cb10c682def54ce9a22445a9b880d8ad, role_id=a10baa216e4941ad8d168a1f7825a966)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:33.648036 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64586b-c39a-48df-971d-e89cc76f54ed None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:33.663442 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 289/575] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 24 17:14:33 2022] PUT /identity/v3/projects/fb66039441c14b96a79a30de4a833fa2/users/cb10c682def54ce9a22445a9b880d8ad/roles/a10baa216e4941ad8d168a1f7825a966 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:14:33.664313 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64586b-c39a-48df-971d-e89cc76f54ed None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:33.733647 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5d602-72ef-4cbb-8580-de180447a4ae None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:33.774538 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fcfd0-af27-4995-b354-e7f6f603f97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:33.775292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fcfd0-af27-4995-b354-e7f6f603f97b None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:33.775572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fcfd0-af27-4995-b354-e7f6f603f97b None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:33.775848 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fcfd0-af27-4995-b354-e7f6f603f97b None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:33.776582 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fcfd0-af27-4995-b354-e7f6f603f97b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:33.776891 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fcfd0-af27-4995-b354-e7f6f603f97b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:33.778371 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fcfd0-af27-4995-b354-e7f6f603f97b None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:33.793793 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 287/576] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:33.799336 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fcfd0-af27-4995-b354-e7f6f603f97b None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:33.816098 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64586b-c39a-48df-971d-e89cc76f54ed None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:33.819366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:33.873995 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af551ec5-42d9-4d77-ad38-0f40392e526f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:33.875179 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af551ec5-42d9-4d77-ad38-0f40392e526f None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:33.875706 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af551ec5-42d9-4d77-ad38-0f40392e526f None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:33.876221 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af551ec5-42d9-4d77-ad38-0f40392e526f None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:33.877212 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af551ec5-42d9-4d77-ad38-0f40392e526f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:33.877771 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af551ec5-42d9-4d77-ad38-0f40392e526f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:33.879495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af551ec5-42d9-4d77-ad38-0f40392e526f None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:33.891414 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:33.893633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 290/577] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:33.900810 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af551ec5-42d9-4d77-ad38-0f40392e526f None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:33.943599 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fcfd0-af27-4995-b354-e7f6f603f97b None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:33.998164 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d33134-aa9b-4f82-990b-73b5ac6f7ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:33.999035 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d33134-aa9b-4f82-990b-73b5ac6f7ee5 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:33.999318 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d33134-aa9b-4f82-990b-73b5ac6f7ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:33.999590 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d33134-aa9b-4f82-990b-73b5ac6f7ee5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:34.011504 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d33134-aa9b-4f82-990b-73b5ac6f7ee5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:34.014155 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d33134-aa9b-4f82-990b-73b5ac6f7ee5 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:34.034325 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-a0d33134-aa9b-4f82-990b-73b5ac6f7ee5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:34.034325 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:34.034325 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:34.034325 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:34.034325 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:34.034325 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:34.034325 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:34.034325 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:34.034325 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:34.034325 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:34.034325 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:34.034325 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:34.034325 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 17:14:34.034325 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 17:14:34.034325 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 17:14:34.035391 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 17:14:34.035391 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:34.035391 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:34.035391 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:34.035391 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:34.035391 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:34.035391 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:34.035391 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:34.035391 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:34.035391 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:34.035391 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:34.035391 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:34.035391 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:34.035391 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:34.035391 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:34.035391 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:34.035391 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:34.036288 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 17:14:34.036288 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 17:14:34.036288 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 17:14:34.036288 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 17:14:34.036288 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 17:14:34.036288 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 17:14:34.036288 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:34.036288 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:34.036717 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af551ec5-42d9-4d77-ad38-0f40392e526f None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:34.040148 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 288/578] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:14:34.046619 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d33134-aa9b-4f82-990b-73b5ac6f7ee5 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:34.076818 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f122f-14fa-4856-ad28-7e29dbd2e57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:34.078068 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f122f-14fa-4856-ad28-7e29dbd2e57c None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:34.078638 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f122f-14fa-4856-ad28-7e29dbd2e57c None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:34.079197 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f122f-14fa-4856-ad28-7e29dbd2e57c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:34.087190 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f122f-14fa-4856-ad28-7e29dbd2e57c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:34.088986 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f122f-14fa-4856-ad28-7e29dbd2e57c None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:34.104851 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-fc9f122f-14fa-4856-ad28-7e29dbd2e57c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:34.104851 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:34.104851 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:34.104851 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:34.104851 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:34.104851 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:34.104851 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:34.104851 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:34.104851 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:34.104851 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:34.104851 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:34.104851 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:34.104851 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 17:14:34.104851 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 17:14:34.104851 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 17:14:34.105788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 17:14:34.105788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:34.105788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:34.105788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:34.105788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:34.105788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:34.105788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:34.105788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:34.105788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:34.105788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:34.105788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:34.105788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:34.105788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:34.105788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:34.105788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:34.105788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:34.105788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:34.106742 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 17:14:34.106742 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 17:14:34.106742 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 17:14:34.106742 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 17:14:34.106742 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 17:14:34.106742 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 17:14:34.106742 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:34.106742 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:34.109218 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 291/579] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:34.116159 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f122f-14fa-4856-ad28-7e29dbd2e57c None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:34.142087 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:34.169118 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d33134-aa9b-4f82-990b-73b5ac6f7ee5 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:34.211754 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1b28c-4007-4b48-ade8-8816d09edee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:34.213145 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1b28c-4007-4b48-ade8-8816d09edee1 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:34.213561 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1b28c-4007-4b48-ade8-8816d09edee1 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:34.213963 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1b28c-4007-4b48-ade8-8816d09edee1 None admin] PATH_INFO: `/v3/projects` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:34.214912 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1b28c-4007-4b48-ade8-8816d09edee1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:34.215402 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1b28c-4007-4b48-ade8-8816d09edee1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:34.217811 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1b28c-4007-4b48-ade8-8816d09edee1 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:34.229305 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f122f-14fa-4856-ad28-7e29dbd2e57c None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:34.231101 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:34.244558 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 289/580] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 24 17:14:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:34.247044 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1b28c-4007-4b48-ade8-8816d09edee1 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:34.274680 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5aced6-e11a-4c9a-a3fe-91c6761ef12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:34.275390 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5aced6-e11a-4c9a-a3fe-91c6761ef12c None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:34.275707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5aced6-e11a-4c9a-a3fe-91c6761ef12c None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:34.276016 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5aced6-e11a-4c9a-a3fe-91c6761ef12c None admin] PATH_INFO: `/v3/projects` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:34.276845 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5aced6-e11a-4c9a-a3fe-91c6761ef12c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:34.277189 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5aced6-e11a-4c9a-a3fe-91c6761ef12c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:34.278733 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5aced6-e11a-4c9a-a3fe-91c6761ef12c None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:34.298209 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 292/581] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 24 17:14:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:34.304023 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5aced6-e11a-4c9a-a3fe-91c6761ef12c None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:34.370075 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1b28c-4007-4b48-ade8-8816d09edee1 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:34.416746 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e476f-9a21-4c00-ad33-6672ab1d4aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:34.418026 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:34.419598 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e476f-9a21-4c00-ad33-6672ab1d4aa7 None admin] REQUEST_METHOD: `PUT` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:34.419925 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e476f-9a21-4c00-ad33-6672ab1d4aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:34.420202 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e476f-9a21-4c00-ad33-6672ab1d4aa7 None admin] PATH_INFO: `/v3/projects/fb66039441c14b96a79a30de4a833fa2/users/aa7e8d98fb4744b7af95aa93050318d4/roles/a10baa216e4941ad8d168a1f7825a966` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:34.441080 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e476f-9a21-4c00-ad33-6672ab1d4aa7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb66039441c14b96a79a30de4a833fa2, user_id=aa7e8d98fb4744b7af95aa93050318d4, role_id=a10baa216e4941ad8d168a1f7825a966)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:34.442553 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e476f-9a21-4c00-ad33-6672ab1d4aa7 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:34.442938 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5aced6-e11a-4c9a-a3fe-91c6761ef12c None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:34.467795 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 290/582] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 24 17:14:34 2022] PUT /identity/v3/projects/fb66039441c14b96a79a30de4a833fa2/users/aa7e8d98fb4744b7af95aa93050318d4/roles/a10baa216e4941ad8d168a1f7825a966 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:14:34.493923 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632fa5b-82a0-42f7-815a-e6f6e94eac10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:34.494916 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632fa5b-82a0-42f7-815a-e6f6e94eac10 None admin] REQUEST_METHOD: `PUT` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:34.495292 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632fa5b-82a0-42f7-815a-e6f6e94eac10 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:34.495610 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632fa5b-82a0-42f7-815a-e6f6e94eac10 None admin] PATH_INFO: `/v3/projects/fb66039441c14b96a79a30de4a833fa2/users/f6385ebfadc74598b3b024408455842e/roles/a10baa216e4941ad8d168a1f7825a966` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:34.515895 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632fa5b-82a0-42f7-815a-e6f6e94eac10 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb66039441c14b96a79a30de4a833fa2, user_id=f6385ebfadc74598b3b024408455842e, role_id=a10baa216e4941ad8d168a1f7825a966)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:34.517521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632fa5b-82a0-42f7-815a-e6f6e94eac10 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:34.535686 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 293/583] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 24 17:14:34 2022] PUT /identity/v3/projects/fb66039441c14b96a79a30de4a833fa2/users/f6385ebfadc74598b3b024408455842e/roles/a10baa216e4941ad8d168a1f7825a966 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:14:35.548702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb7e63-d9e8-4d50-92ba-76ab9454c450 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:35.549238 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb7e63-d9e8-4d50-92ba-76ab9454c450 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:35.549238 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb7e63-d9e8-4d50-92ba-76ab9454c450 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:35.550853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 291/584] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:35.556481 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbed90-be3c-4d6d-b0f7-275b2ef1016b None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:35.556890 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbed90-be3c-4d6d-b0f7-275b2ef1016b None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:35.557110 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbed90-be3c-4d6d-b0f7-275b2ef1016b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:35.574551 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-48bbed90-be3c-4d6d-b0f7-275b2ef1016b None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:35.575815 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-48bbed90-be3c-4d6d-b0f7-275b2ef1016b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:35.651132 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 294/585] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:35.675151 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb7e63-d9e8-4d50-92ba-76ab9454c450 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:35.719862 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:35.784888 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb7e63-d9e8-4d50-92ba-76ab9454c450 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:35.820225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bfd31-8758-4c68-90f3-0a3fd770fca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:35.820948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bfd31-8758-4c68-90f3-0a3fd770fca0 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:35.821223 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bfd31-8758-4c68-90f3-0a3fd770fca0 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:35.821490 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bfd31-8758-4c68-90f3-0a3fd770fca0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:35.831746 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bfd31-8758-4c68-90f3-0a3fd770fca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:35.839567 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-ad2bfd31-8758-4c68-90f3-0a3fd770fca0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:35.839567 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:35.839567 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:35.839567 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:35.839567 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:35.839567 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:35.839567 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:35.839567 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:35.839567 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:35.839567 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:35.839567 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:35.839567 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:35.839567 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:35.839567 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:35.839567 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:35.839567 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:35.840510 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:35.840510 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:35.840510 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:35.840510 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:35.840510 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:35.840510 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:35.840510 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:35.840510 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:35.840510 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:35.840510 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:35.840510 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:35.840510 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:35.840510 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:35.840510 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:35.840510 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:35.840510 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:35.841359 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:35.841359 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:35.841359 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:35.841359 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:35.841359 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:35.841359 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:35.841359 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:35.841359 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:35.841359 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:35.841359 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:35.841359 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:35.841359 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:35.841359 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 292/586] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 24 17:14:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:35.847745 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbed90-be3c-4d6d-b0f7-275b2ef1016b None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:35.915120 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:35.955886 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbed90-be3c-4d6d-b0f7-275b2ef1016b None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:35.990721 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3a07f-8020-4703-a1ed-18e1edbd1458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:35.991431 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3a07f-8020-4703-a1ed-18e1edbd1458 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:35.991747 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3a07f-8020-4703-a1ed-18e1edbd1458 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:35.992055 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3a07f-8020-4703-a1ed-18e1edbd1458 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:35.992831 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3a07f-8020-4703-a1ed-18e1edbd1458 None admin] RBAC: Adding query filter params (name=service) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:35.993169 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3a07f-8020-4703-a1ed-18e1edbd1458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:35.994626 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3a07f-8020-4703-a1ed-18e1edbd1458 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:36.003003 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 295/587] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 24 17:14:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:36.009049 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bfd31-8758-4c68-90f3-0a3fd770fca0 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:36.112060 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:36.113541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5addd7-5882-40b9-b610-7c2273355fcc None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:36.114080 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5addd7-5882-40b9-b610-7c2273355fcc None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:36.114626 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5addd7-5882-40b9-b610-7c2273355fcc None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:36.120364 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bfd31-8758-4c68-90f3-0a3fd770fca0 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:36.120811 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 296/588] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 17:14:36.122535 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c992fc-e26a-4c10-b7dc-a53e004ab89e None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:36.123093 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c992fc-e26a-4c10-b7dc-a53e004ab89e None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:36.123598 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c992fc-e26a-4c10-b7dc-a53e004ab89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:36.140784 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-b9c992fc-e26a-4c10-b7dc-a53e004ab89e None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:36.142328 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-b9c992fc-e26a-4c10-b7dc-a53e004ab89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:36.152904 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2fede-348c-4b83-a982-0714895beb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:36.153888 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2fede-348c-4b83-a982-0714895beb58 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:36.154067 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2fede-348c-4b83-a982-0714895beb58 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:36.154338 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2fede-348c-4b83-a982-0714895beb58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:36.166409 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2fede-348c-4b83-a982-0714895beb58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:36.167688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2fede-348c-4b83-a982-0714895beb58 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:36.186225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-f0f2fede-348c-4b83-a982-0714895beb58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:36.186225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:36.186225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:36.186225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:36.186225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:36.186225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:36.186225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:36.186225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:36.186225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:36.186225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:36.186225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:36.186225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:36.186225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:36.186225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:36.186225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:36.187213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:36.187213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:36.187213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:36.187213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:36.187213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:36.187213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:36.187213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:36.187213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:36.187213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:36.187213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:36.187213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:36.187213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:36.187213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:36.187213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:36.187213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:36.187213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:36.187213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:36.188093 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:36.188093 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:36.188093 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:36.188093 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:36.188093 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 293/589] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:14:36.193376 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2fede-348c-4b83-a982-0714895beb58 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:36.218766 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 297/590] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:36.243568 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c992fc-e26a-4c10-b7dc-a53e004ab89e None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:36.301552 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:36.304298 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2fede-348c-4b83-a982-0714895beb58 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:36.343557 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117ae1c-cc0d-4815-95ba-1867389b21a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:36.344226 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117ae1c-cc0d-4815-95ba-1867389b21a2 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:36.344503 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117ae1c-cc0d-4815-95ba-1867389b21a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:36.344772 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117ae1c-cc0d-4815-95ba-1867389b21a2 None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:36.345495 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117ae1c-cc0d-4815-95ba-1867389b21a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:36.345795 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117ae1c-cc0d-4815-95ba-1867389b21a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:36.347303 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117ae1c-cc0d-4815-95ba-1867389b21a2 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:36.360075 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c992fc-e26a-4c10-b7dc-a53e004ab89e None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:36.361094 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 294/591] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:36.366386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117ae1c-cc0d-4815-95ba-1867389b21a2 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:36.383764 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:36.400619 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc0565-04f6-4e86-8f76-2fbc1f6e3fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:36.401944 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc0565-04f6-4e86-8f76-2fbc1f6e3fc1 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:36.402508 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc0565-04f6-4e86-8f76-2fbc1f6e3fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:36.403044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc0565-04f6-4e86-8f76-2fbc1f6e3fc1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:36.415667 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc0565-04f6-4e86-8f76-2fbc1f6e3fc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:36.424150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-9ffc0565-04f6-4e86-8f76-2fbc1f6e3fc1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:36.424150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:36.424150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:36.424150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:36.424150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:36.424150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:36.424150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:36.424150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:36.424150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:36.424150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:36.424150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:36.424150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:36.424150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:36.424150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:36.424150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:36.424150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:36.425052 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:36.425052 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:36.425052 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:36.425052 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:36.425052 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:36.425052 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:36.425052 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:36.425052 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:36.425052 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:36.425052 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:36.425052 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:36.425052 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:36.425052 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:36.425052 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:36.425052 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:36.425052 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:36.425965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:36.425965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:36.425965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:36.425965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:36.425965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:36.425965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:36.425965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:36.425965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:36.425965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:36.425965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:36.425965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:36.425965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:36.433837 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 298/592] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 24 17:14:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:14:36.435272 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc0565-04f6-4e86-8f76-2fbc1f6e3fc1 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:36.486064 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117ae1c-cc0d-4815-95ba-1867389b21a2 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:36.522862 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aead4-6f6c-40d9-9285-a5f097276d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:36.524069 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aead4-6f6c-40d9-9285-a5f097276d51 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:36.524537 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aead4-6f6c-40d9-9285-a5f097276d51 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:36.525012 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aead4-6f6c-40d9-9285-a5f097276d51 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:36.533358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1aead4-6f6c-40d9-9285-a5f097276d51 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:36.535191 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1aead4-6f6c-40d9-9285-a5f097276d51 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:36.550687 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-9d1aead4-6f6c-40d9-9285-a5f097276d51 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 17:14:36.550687 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:36.550687 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:36.550687 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:36.550687 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:36.550687 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:36.550687 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:36.550687 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:36.550687 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:36.550687 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:36.550687 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:36.550687 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:36.550687 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 17:14:36.550687 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 17:14:36.550687 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 17:14:36.550687 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 17:14:36.552110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:36.552110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:36.552110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 17:14:36.552110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:36.552110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 17:14:36.552110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:36.552110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:36.552110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:36.552110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:36.552110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:36.552110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:36.552110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:36.552110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:36.552110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:36.552110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:36.552110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:36.552110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:36.552110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:36.553252 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:36.553252 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:36.553252 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 17:14:36.553252 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 17:14:36.553252 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 17:14:36.553252 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 17:14:36.553252 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 17:14:36.553252 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 17:14:36.553252 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 17:14:36.553252 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:36.555985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 295/593] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Jun 24 17:14:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:36.561966 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aead4-6f6c-40d9-9285-a5f097276d51 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:36.564231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc0565-04f6-4e86-8f76-2fbc1f6e3fc1 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:36.582388 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:36.609688 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0204c-538b-4c9c-8faf-c28e99819b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:36.610419 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0204c-538b-4c9c-8faf-c28e99819b62 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:36.610839 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0204c-538b-4c9c-8faf-c28e99819b62 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:36.611155 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0204c-538b-4c9c-8faf-c28e99819b62 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:36.611950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0204c-538b-4c9c-8faf-c28e99819b62 None admin] RBAC: Adding query filter params (name=service) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:36.612296 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0204c-538b-4c9c-8faf-c28e99819b62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:36.613719 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0204c-538b-4c9c-8faf-c28e99819b62 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:36.626692 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 299/594] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 24 17:14:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:36.630407 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0204c-538b-4c9c-8faf-c28e99819b62 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:36.658816 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:36.705139 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aead4-6f6c-40d9-9285-a5f097276d51 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:36.747388 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a2131-9368-4f48-a313-527b898eec10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:36.748566 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a2131-9368-4f48-a313-527b898eec10 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:36.748939 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a2131-9368-4f48-a313-527b898eec10 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:36.749303 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a2131-9368-4f48-a313-527b898eec10 None admin] PATH_INFO: `/v3/users` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:36.750498 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a2131-9368-4f48-a313-527b898eec10 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:36.750933 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a2131-9368-4f48-a313-527b898eec10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:36.752916 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a2131-9368-4f48-a313-527b898eec10 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:36.771177 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0204c-538b-4c9c-8faf-c28e99819b62 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:36.775512 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 296/595] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Jun 24 17:14:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:36.781322 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a2131-9368-4f48-a313-527b898eec10 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:36.815162 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f6287-c143-4129-a65d-7a498e27a121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:36.816264 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f6287-c143-4129-a65d-7a498e27a121 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:36.816584 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f6287-c143-4129-a65d-7a498e27a121 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:36.817307 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f6287-c143-4129-a65d-7a498e27a121 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:36.832259 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f6287-c143-4129-a65d-7a498e27a121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:36.833972 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f6287-c143-4129-a65d-7a498e27a121 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:36.855640 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-1a0f6287-c143-4129-a65d-7a498e27a121 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:36.855640 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:36.855640 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:36.855640 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:36.855640 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:36.855640 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:36.855640 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:36.855640 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:36.855640 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:36.855640 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:36.855640 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:36.855640 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:36.855640 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:36.855640 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:36.855640 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:36.856565 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:36.856565 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:36.856565 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:36.856565 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:36.856565 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:36.856565 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:36.856565 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:36.856565 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:36.856565 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:36.856565 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:36.856565 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:36.856565 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:36.856565 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:36.856565 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:36.856565 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:36.856565 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:36.856565 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:36.857423 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:36.857423 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:36.857423 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:36.857423 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:36.864262 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 300/596] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:14:36.865688 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f6287-c143-4129-a65d-7a498e27a121 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:36.896024 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:36.905499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a2131-9368-4f48-a313-527b898eec10 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:36.933706 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:36.941726 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b02a6-dfbd-4181-bda4-34fd4d0920c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:36.942371 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b02a6-dfbd-4181-bda4-34fd4d0920c6 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:36.942674 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b02a6-dfbd-4181-bda4-34fd4d0920c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:36.942971 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b02a6-dfbd-4181-bda4-34fd4d0920c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:36.969614 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f6287-c143-4129-a65d-7a498e27a121 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:37.003355 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0e8b4-4fd2-4e5e-b7f3-ec65e8fd1446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:37.004057 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0e8b4-4fd2-4e5e-b7f3-ec65e8fd1446 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:37.004376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0e8b4-4fd2-4e5e-b7f3-ec65e8fd1446 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:37.004681 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0e8b4-4fd2-4e5e-b7f3-ec65e8fd1446 None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:37.005458 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0e8b4-4fd2-4e5e-b7f3-ec65e8fd1446 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:37.005859 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0e8b4-4fd2-4e5e-b7f3-ec65e8fd1446 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:37.007306 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0e8b4-4fd2-4e5e-b7f3-ec65e8fd1446 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:37.010050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b02a6-dfbd-4181-bda4-34fd4d0920c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:37.011532 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b02a6-dfbd-4181-bda4-34fd4d0920c6 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:37.019890 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 301/597] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:37.021940 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f6783-f112-4f78-97f6-159445e2b7b3 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:37.022274 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f6783-f112-4f78-97f6-159445e2b7b3 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:37.022602 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f6783-f112-4f78-97f6-159445e2b7b3 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:37.024132 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 302/598] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:37.028157 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab99369-f51e-4a58-98a8-bf6575a25857 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:37.028545 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab99369-f51e-4a58-98a8-bf6575a25857 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:37.028922 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab99369-f51e-4a58-98a8-bf6575a25857 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:37.030235 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 303/599] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:37.031003 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab99369-f51e-4a58-98a8-bf6575a25857 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:37.118727 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:37.119595 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 297/600] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:14:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 17:14:37.120981 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb1ec2-f52d-4233-8ffd-b8ae6998cfc9 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:37.121302 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb1ec2-f52d-4233-8ffd-b8ae6998cfc9 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:37.121566 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb1ec2-f52d-4233-8ffd-b8ae6998cfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:37.137300 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab99369-f51e-4a58-98a8-bf6575a25857 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:37.137911 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-5beb1ec2-f52d-4233-8ffd-b8ae6998cfc9 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:37.139134 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-5beb1ec2-f52d-4233-8ffd-b8ae6998cfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:37.163586 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:37.172794 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f9b47-0854-49a6-8084-23bd5077b995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:37.173634 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f9b47-0854-49a6-8084-23bd5077b995 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:37.173950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f9b47-0854-49a6-8084-23bd5077b995 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:37.174262 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f9b47-0854-49a6-8084-23bd5077b995 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:37.182024 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f9b47-0854-49a6-8084-23bd5077b995 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:37.183545 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f9b47-0854-49a6-8084-23bd5077b995 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:37.199231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-150f9b47-0854-49a6-8084-23bd5077b995 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 17:14:37.199231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:37.199231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:37.199231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:37.199231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:37.199231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:37.199231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:37.199231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:37.199231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:37.199231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:37.199231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:37.199231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:37.199231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 17:14:37.199231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 17:14:37.199231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 17:14:37.199231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 17:14:37.200381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:37.200381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:37.200381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 17:14:37.200381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:37.200381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 17:14:37.200381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:37.200381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:37.200381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:37.200381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:37.200381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:37.200381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:37.200381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:37.200381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:37.200381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:37.200381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:37.200381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:37.200381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:37.200381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:37.201593 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:37.201593 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:37.201593 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 17:14:37.201593 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 17:14:37.201593 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 17:14:37.201593 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 17:14:37.201593 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 17:14:37.201593 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 17:14:37.201593 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 17:14:37.201593 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:37.201593 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 304/601] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:14:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:37.202175 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f54693-40ab-4a60-b35d-f474f4315b9c None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:37.202242 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f54693-40ab-4a60-b35d-f474f4315b9c None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:37.202605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f54693-40ab-4a60-b35d-f474f4315b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:37.210470 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 298/602] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:37.211351 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb1ec2-f52d-4233-8ffd-b8ae6998cfc9 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:37.220779 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-22f54693-40ab-4a60-b35d-f474f4315b9c None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:37.222004 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-22f54693-40ab-4a60-b35d-f474f4315b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:37.296237 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 305/603] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:37.297241 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f54693-40ab-4a60-b35d-f474f4315b9c None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:37.316760 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb1ec2-f52d-4233-8ffd-b8ae6998cfc9 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:37.350385 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec66635-da49-499e-ac0d-b687e49e0f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:37.351206 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec66635-da49-499e-ac0d-b687e49e0f54 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:37.351477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec66635-da49-499e-ac0d-b687e49e0f54 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:37.351726 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec66635-da49-499e-ac0d-b687e49e0f54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:37.362237 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec66635-da49-499e-ac0d-b687e49e0f54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:37.363729 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec66635-da49-499e-ac0d-b687e49e0f54 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:37.380744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-dec66635-da49-499e-ac0d-b687e49e0f54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:37.380744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:37.380744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:37.380744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:37.380744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:37.380744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:37.380744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:37.380744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:37.380744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:37.380744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:37.380744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:37.380744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:37.380744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:37.380744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:37.380744 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:37.381688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:37.381688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:37.381688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:37.381688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:37.381688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:37.381688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:37.381688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:37.381688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:37.381688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:37.381688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:37.381688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:37.381688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:37.381688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:37.381688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:37.381688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:37.381688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:37.381688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:37.382602 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:37.382602 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:37.382602 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:37.382602 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:37.386522 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 299/604] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:37.387316 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec66635-da49-499e-ac0d-b687e49e0f54 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:37.391585 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:37.399739 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:37.414949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f54693-40ab-4a60-b35d-f474f4315b9c None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:37.450798 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52587e58-c143-4e84-938f-7d333d7c6833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:37.451476 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52587e58-c143-4e84-938f-7d333d7c6833 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:37.451757 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52587e58-c143-4e84-938f-7d333d7c6833 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:37.452026 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52587e58-c143-4e84-938f-7d333d7c6833 None admin] PATH_INFO: `/v3/users` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:37.452854 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52587e58-c143-4e84-938f-7d333d7c6833 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:37.453158 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52587e58-c143-4e84-938f-7d333d7c6833 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:37.454598 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52587e58-c143-4e84-938f-7d333d7c6833 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:37.472655 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 306/605] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Jun 24 17:14:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:37.473449 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52587e58-c143-4e84-938f-7d333d7c6833 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:37.487394 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec66635-da49-499e-ac0d-b687e49e0f54 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:37.521297 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1aa5d-5cb7-412e-b4d7-a530d5cd5630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:37.522179 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1aa5d-5cb7-412e-b4d7-a530d5cd5630 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:37.522458 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1aa5d-5cb7-412e-b4d7-a530d5cd5630 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:37.522841 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1aa5d-5cb7-412e-b4d7-a530d5cd5630 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:37.533312 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1aa5d-5cb7-412e-b4d7-a530d5cd5630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:37.541112 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-65f1aa5d-5cb7-412e-b4d7-a530d5cd5630 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:37.541112 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:37.541112 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:37.541112 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:37.541112 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:37.541112 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:37.541112 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:37.541112 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:37.541112 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:37.541112 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:37.541112 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:37.541112 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:37.541112 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:37.541112 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:37.541112 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:37.541112 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:37.542209 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:37.542209 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:37.542209 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:37.542209 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:37.542209 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:37.542209 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:37.542209 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:37.542209 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:37.542209 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:37.542209 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:37.542209 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:37.542209 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:37.542209 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:37.542209 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:37.542209 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:37.542209 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:37.543261 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:37.543261 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:37.543261 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:37.543261 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:37.543261 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:37.543261 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:37.543261 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:37.543261 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:37.543261 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:37.543261 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:37.543261 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:37.543261 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:37.543261 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 300/606] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 24 17:14:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:37.543261 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1aa5d-5cb7-412e-b4d7-a530d5cd5630 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:37.574738 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52587e58-c143-4e84-938f-7d333d7c6833 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:37.607323 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26dfbd5-93d3-4a30-a491-3453c09e7a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:37.608113 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dfbd5-93d3-4a30-a491-3453c09e7a7c None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:37.608385 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dfbd5-93d3-4a30-a491-3453c09e7a7c None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:37.608649 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dfbd5-93d3-4a30-a491-3453c09e7a7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:37.610450 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:37.611372 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:37.619473 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26dfbd5-93d3-4a30-a491-3453c09e7a7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:37.627020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-e26dfbd5-93d3-4a30-a491-3453c09e7a7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:37.627020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:37.627020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:37.627020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:37.627020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:37.627020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:37.627020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:37.627020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:37.627020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:37.627020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:37.627020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:37.627020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:37.627020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:37.627020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:37.627020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:37.627020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:37.627981 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:37.627981 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:37.627981 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:37.627981 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:37.627981 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:37.627981 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:37.627981 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:37.627981 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:37.627981 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:37.627981 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:37.627981 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:37.627981 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:37.627981 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:37.627981 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:37.627981 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:37.627981 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:37.629011 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:37.629011 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:37.629011 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:37.629011 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:37.629011 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:37.629011 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:37.629011 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:37.629011 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:37.629011 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:37.629011 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:37.629011 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:14:37.629011 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:37.629011 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 307/607] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 24 17:14:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:37.631490 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26dfbd5-93d3-4a30-a491-3453c09e7a7c None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:37.643667 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1aa5d-5cb7-412e-b4d7-a530d5cd5630 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:37.677200 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328135e-0535-4637-8a39-d580c55d81f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:37.677938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328135e-0535-4637-8a39-d580c55d81f0 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:37.678212 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328135e-0535-4637-8a39-d580c55d81f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:37.678505 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328135e-0535-4637-8a39-d580c55d81f0 None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:37.679236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328135e-0535-4637-8a39-d580c55d81f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:37.679563 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328135e-0535-4637-8a39-d580c55d81f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:37.680945 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328135e-0535-4637-8a39-d580c55d81f0 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:37.693206 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 301/608] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:37.693969 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328135e-0535-4637-8a39-d580c55d81f0 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:37.731418 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26dfbd5-93d3-4a30-a491-3453c09e7a7c None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:37.764227 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268faf2-4050-4329-bdb0-b852726528df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:37.764872 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268faf2-4050-4329-bdb0-b852726528df None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:37.765149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268faf2-4050-4329-bdb0-b852726528df None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:37.765422 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268faf2-4050-4329-bdb0-b852726528df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:37.790806 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328135e-0535-4637-8a39-d580c55d81f0 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:37.819778 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:37.825421 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:37.825682 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a254ce-b39d-465e-bda3-e575e57682fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:37.826345 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a254ce-b39d-465e-bda3-e575e57682fe None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:37.826663 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a254ce-b39d-465e-bda3-e575e57682fe None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:37.826923 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a254ce-b39d-465e-bda3-e575e57682fe None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:37.827715 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a254ce-b39d-465e-bda3-e575e57682fe None admin] RBAC: Adding query filter params (name=service) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:37.828015 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a254ce-b39d-465e-bda3-e575e57682fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:37.829451 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a254ce-b39d-465e-bda3-e575e57682fe None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:37.832205 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268faf2-4050-4329-bdb0-b852726528df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:37.833773 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268faf2-4050-4329-bdb0-b852726528df None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:37.837855 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 302/609] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 24 17:14:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:37.838681 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a254ce-b39d-465e-bda3-e575e57682fe None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:37.933814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 308/610] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:14:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:14:37.934192 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a254ce-b39d-465e-bda3-e575e57682fe None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:37.934599 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268faf2-4050-4329-bdb0-b852726528df None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:37.970490 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5dcde-3513-408f-81b1-a7616313beb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:37.971182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5dcde-3513-408f-81b1-a7616313beb5 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:37.971460 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5dcde-3513-408f-81b1-a7616313beb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:37.971731 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5dcde-3513-408f-81b1-a7616313beb5 None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:37.972465 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5dcde-3513-408f-81b1-a7616313beb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:37.972766 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5dcde-3513-408f-81b1-a7616313beb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:37.974190 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5dcde-3513-408f-81b1-a7616313beb5 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:37.983321 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 303/611] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 24 17:14:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:37.983940 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5dcde-3513-408f-81b1-a7616313beb5 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:38.039130 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:38.040591 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:38.045755 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268faf2-4050-4329-bdb0-b852726528df None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:38.079353 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2995790-af5a-4482-9080-b716ef8a77ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:38.080145 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2995790-af5a-4482-9080-b716ef8a77ee None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:38.080420 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2995790-af5a-4482-9080-b716ef8a77ee None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:38.080692 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2995790-af5a-4482-9080-b716ef8a77ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:38.084275 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5dcde-3513-408f-81b1-a7616313beb5 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:38.087296 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2995790-af5a-4482-9080-b716ef8a77ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:38.088760 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2995790-af5a-4482-9080-b716ef8a77ee None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:38.102541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-f2995790-af5a-4482-9080-b716ef8a77ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:38.102541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:38.102541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:38.102541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:38.102541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:38.102541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:38.102541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:38.102541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:38.102541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:38.102541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:38.102541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:38.102541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:38.102541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 17:14:38.102541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 17:14:38.102541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 17:14:38.103571 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 17:14:38.103571 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:38.103571 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:38.103571 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:38.103571 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:38.103571 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:38.103571 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:38.103571 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:38.103571 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:38.103571 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:38.103571 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:38.103571 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:38.103571 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:38.103571 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:38.103571 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:38.103571 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:38.103571 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:38.104691 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 17:14:38.104691 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 17:14:38.104691 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 17:14:38.104691 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 17:14:38.104691 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 17:14:38.104691 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 17:14:38.104691 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:38.104691 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:38.106742 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 309/612] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:38.107739 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2995790-af5a-4482-9080-b716ef8a77ee None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:38.119569 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb81ed0-256f-4e50-8060-421d3062a24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:38.120376 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb81ed0-256f-4e50-8060-421d3062a24d None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:38.120652 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb81ed0-256f-4e50-8060-421d3062a24d None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:38.120920 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb81ed0-256f-4e50-8060-421d3062a24d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:38.131853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb81ed0-256f-4e50-8060-421d3062a24d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:38.133306 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb81ed0-256f-4e50-8060-421d3062a24d None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:38.151400 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-2fb81ed0-256f-4e50-8060-421d3062a24d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:38.151400 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:38.151400 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:38.151400 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:38.151400 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:38.151400 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:38.151400 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:38.151400 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:38.151400 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:38.151400 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:38.151400 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:38.151400 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:38.151400 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:38.151400 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:38.151400 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:38.152440 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:38.152440 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:38.152440 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:38.152440 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:38.152440 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:38.152440 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:38.152440 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:38.152440 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:38.152440 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:38.152440 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:38.152440 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:38.152440 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:38.152440 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:38.152440 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:38.152440 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:38.152440 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:38.152440 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:38.153515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:38.153515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:38.153515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:38.153515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:38.153515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 304/613] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:38.153859 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb81ed0-256f-4e50-8060-421d3062a24d None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:38.208439 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2995790-af5a-4482-9080-b716ef8a77ee None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:38.241276 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1aa04-0365-435d-a16b-296385832313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:38.242081 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1aa04-0365-435d-a16b-296385832313 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:38.242410 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1aa04-0365-435d-a16b-296385832313 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:38.242729 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1aa04-0365-435d-a16b-296385832313 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:38.254076 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1aa04-0365-435d-a16b-296385832313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:38.255675 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1aa04-0365-435d-a16b-296385832313 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:38.255900 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb81ed0-256f-4e50-8060-421d3062a24d None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:38.266189 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:38.274425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-5ad1aa04-0365-435d-a16b-296385832313 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:38.274425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:38.274425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:38.274425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:38.274425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:38.274425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:38.274425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:38.274425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:38.274425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:38.274425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:38.274425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:38.274425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:38.274425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:38.274425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:38.274425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:38.275495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:38.275495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:38.275495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:38.275495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:38.275495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:38.275495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:38.275495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:38.275495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:38.275495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:38.275495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:38.275495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:38.275495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:38.275495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:38.275495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:38.275495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:38.275495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:38.275495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:38.276398 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:38.276398 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:38.276398 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:38.276398 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:38.276398 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 310/614] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:38.276398 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1aa04-0365-435d-a16b-296385832313 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:38.289502 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:38.294945 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748cb13-dbe7-460e-acf5-2d7bba14f964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:38.295749 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748cb13-dbe7-460e-acf5-2d7bba14f964 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:38.296026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748cb13-dbe7-460e-acf5-2d7bba14f964 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:38.296295 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748cb13-dbe7-460e-acf5-2d7bba14f964 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:38.307370 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748cb13-dbe7-460e-acf5-2d7bba14f964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:38.308825 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748cb13-dbe7-460e-acf5-2d7bba14f964 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:38.325545 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-6748cb13-dbe7-460e-acf5-2d7bba14f964 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:38.325545 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:38.325545 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:38.325545 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:38.325545 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:38.325545 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:38.325545 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:38.325545 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:38.325545 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:38.325545 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:38.325545 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:38.325545 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:38.325545 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:38.325545 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:38.325545 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:38.326634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:38.326634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:38.326634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:38.326634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:38.326634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:38.326634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:38.326634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:38.326634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:38.326634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:38.326634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:38.326634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:38.326634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:38.326634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:38.326634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:38.326634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:38.326634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:38.326634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:38.327517 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:38.327517 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:38.327517 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:38.327517 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:38.327517 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 305/615] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:38.327517 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748cb13-dbe7-460e-acf5-2d7bba14f964 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:38.394327 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1aa04-0365-435d-a16b-296385832313 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:38.426868 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314e2b7-3d90-4498-81fb-36f2dd12cd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:38.427909 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314e2b7-3d90-4498-81fb-36f2dd12cd91 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:38.428182 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314e2b7-3d90-4498-81fb-36f2dd12cd91 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:38.428455 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314e2b7-3d90-4498-81fb-36f2dd12cd91 None admin] PATH_INFO: `/v3/projects` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:38.429230 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314e2b7-3d90-4498-81fb-36f2dd12cd91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:38.429527 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314e2b7-3d90-4498-81fb-36f2dd12cd91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:38.431028 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314e2b7-3d90-4498-81fb-36f2dd12cd91 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:38.438373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748cb13-dbe7-460e-acf5-2d7bba14f964 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:38.442888 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 311/616] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 24 17:14:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:38.443878 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314e2b7-3d90-4498-81fb-36f2dd12cd91 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:38.473356 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a6099-3a5d-46cf-9fa9-e69c22067b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:38.473943 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a6099-3a5d-46cf-9fa9-e69c22067b2a None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:38.474213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a6099-3a5d-46cf-9fa9-e69c22067b2a None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:38.474975 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a6099-3a5d-46cf-9fa9-e69c22067b2a None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:38.475565 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a6099-3a5d-46cf-9fa9-e69c22067b2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:38.475856 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a6099-3a5d-46cf-9fa9-e69c22067b2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:38.477234 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a6099-3a5d-46cf-9fa9-e69c22067b2a None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:38.488530 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 306/617] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:38.489322 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a6099-3a5d-46cf-9fa9-e69c22067b2a None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:38.511175 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:38.513301 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:38.546503 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314e2b7-3d90-4498-81fb-36f2dd12cd91 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:38.579699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8df0f4-a453-420b-984f-09c76183e237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:38.580320 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df0f4-a453-420b-984f-09c76183e237 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:38.580616 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df0f4-a453-420b-984f-09c76183e237 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:38.580878 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df0f4-a453-420b-984f-09c76183e237 None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:38.581592 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8df0f4-a453-420b-984f-09c76183e237 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:38.581893 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8df0f4-a453-420b-984f-09c76183e237 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:38.583402 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8df0f4-a453-420b-984f-09c76183e237 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:38.594460 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 312/618] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:38.594813 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a6099-3a5d-46cf-9fa9-e69c22067b2a None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:38.595282 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8df0f4-a453-420b-984f-09c76183e237 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:38.632727 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2efe3-ef54-4fcd-9492-0ffc754aaad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:38.633360 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2efe3-ef54-4fcd-9492-0ffc754aaad6 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:38.633643 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2efe3-ef54-4fcd-9492-0ffc754aaad6 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:38.633909 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2efe3-ef54-4fcd-9492-0ffc754aaad6 None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:38.634653 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2efe3-ef54-4fcd-9492-0ffc754aaad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:38.634952 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2efe3-ef54-4fcd-9492-0ffc754aaad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:38.636321 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2efe3-ef54-4fcd-9492-0ffc754aaad6 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:38.648904 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 307/619] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:38.649749 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2efe3-ef54-4fcd-9492-0ffc754aaad6 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:38.702382 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8df0f4-a453-420b-984f-09c76183e237 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:38.728383 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:38.728839 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:38.737545 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda04e53-a16d-4f99-8bac-f148d9758edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:38.738201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda04e53-a16d-4f99-8bac-f148d9758edc None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:38.738488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda04e53-a16d-4f99-8bac-f148d9758edc None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:38.738792 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda04e53-a16d-4f99-8bac-f148d9758edc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:38.739751 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda04e53-a16d-4f99-8bac-f148d9758edc None admin] RBAC: Adding query filter params (role.id=a10baa216e4941ad8d168a1f7825a966, scope.project.id=fb66039441c14b96a79a30de4a833fa2, user.id=9ff8200a750d49b1830c58f279e569c3) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:38.740058 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda04e53-a16d-4f99-8bac-f148d9758edc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:38.741485 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda04e53-a16d-4f99-8bac-f148d9758edc None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:38.747446 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 313/620] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:14:38 2022] GET /identity/v3/role_assignments?user.id=9ff8200a750d49b1830c58f279e569c3&scope.project.id=fb66039441c14b96a79a30de4a833fa2&role.id=a10baa216e4941ad8d168a1f7825a966 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:38.748140 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda04e53-a16d-4f99-8bac-f148d9758edc None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:38.754158 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2efe3-ef54-4fcd-9492-0ffc754aaad6 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:38.794360 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f897cc3-6a7b-48e5-af69-d4eb7375221f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:38.795205 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f897cc3-6a7b-48e5-af69-d4eb7375221f None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:38.795541 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f897cc3-6a7b-48e5-af69-d4eb7375221f None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:38.795811 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f897cc3-6a7b-48e5-af69-d4eb7375221f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:38.804902 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f897cc3-6a7b-48e5-af69-d4eb7375221f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:38.806387 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f897cc3-6a7b-48e5-af69-d4eb7375221f None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:38.821958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-0f897cc3-6a7b-48e5-af69-d4eb7375221f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 17:14:38.821958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:38.821958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:38.821958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:38.821958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:38.821958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:38.821958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:38.821958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:38.821958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:38.821958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:38.821958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:38.821958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:38.821958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 17:14:38.821958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 17:14:38.821958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 17:14:38.821958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 17:14:38.823150 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:38.823150 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:38.823150 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 17:14:38.823150 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:38.823150 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 17:14:38.823150 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:38.823150 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:38.823150 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:38.823150 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:38.823150 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:38.823150 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:38.823150 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:38.823150 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:38.823150 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:38.823150 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:38.823150 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:38.823150 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:38.823150 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:38.824072 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:38.824072 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:38.824072 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 17:14:38.824072 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 17:14:38.824072 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 17:14:38.824072 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 17:14:38.824072 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 17:14:38.824072 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 17:14:38.824072 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 17:14:38.824072 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:38.824072 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 308/621] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:14:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:38.824072 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f897cc3-6a7b-48e5-af69-d4eb7375221f None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:38.875302 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda04e53-a16d-4f99-8bac-f148d9758edc None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:38.913752 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befee11-436f-4f5c-9c86-38c08f2e02d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:38.914723 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befee11-436f-4f5c-9c86-38c08f2e02d8 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:38.915058 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befee11-436f-4f5c-9c86-38c08f2e02d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:38.915390 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befee11-436f-4f5c-9c86-38c08f2e02d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:38.923147 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befee11-436f-4f5c-9c86-38c08f2e02d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:38.924702 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befee11-436f-4f5c-9c86-38c08f2e02d8 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:38.939715 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-5befee11-436f-4f5c-9c86-38c08f2e02d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:38.939715 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:38.939715 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:38.939715 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:38.939715 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:38.939715 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:38.939715 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:38.939715 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:38.939715 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:38.939715 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:38.939715 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:38.939715 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:38.939715 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 17:14:38.939715 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 17:14:38.939715 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 17:14:38.941728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 17:14:38.941728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:38.941728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:38.941728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:38.941728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:38.941728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:38.941728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:38.941728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:38.941728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:38.941728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:38.941728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:38.941728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:38.941728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:38.941728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:38.941728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:38.941728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:38.941728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:38.943093 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 17:14:38.943093 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 17:14:38.943093 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 17:14:38.943093 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 17:14:38.943093 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 17:14:38.943093 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 17:14:38.943093 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:38.943093 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:38.946000 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 314/622] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:38.946154 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f897cc3-6a7b-48e5-af69-d4eb7375221f None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:38.946891 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befee11-436f-4f5c-9c86-38c08f2e02d8 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:38.987179 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b5b0b-fd90-42bd-9f02-1057011e986b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:38.987903 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b5b0b-fd90-42bd-9f02-1057011e986b None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:38.988182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b5b0b-fd90-42bd-9f02-1057011e986b None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:38.989256 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b5b0b-fd90-42bd-9f02-1057011e986b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:38.998459 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b5b0b-fd90-42bd-9f02-1057011e986b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:39.000408 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b5b0b-fd90-42bd-9f02-1057011e986b None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:39.003036 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:39.004228 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:39.028499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-0c2b5b0b-fd90-42bd-9f02-1057011e986b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 17:14:39.028499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:39.028499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:39.028499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:39.028499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:39.028499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:39.028499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:39.028499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:39.028499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:39.028499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:39.028499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:39.028499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:39.028499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 17:14:39.028499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 17:14:39.028499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 17:14:39.028499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 17:14:39.030287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:39.030287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:39.030287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 17:14:39.030287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:39.030287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 17:14:39.030287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:39.030287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:39.030287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:39.030287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:39.030287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:39.030287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:39.030287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:39.030287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:39.030287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:39.030287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:39.030287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:39.030287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:39.030287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:39.033008 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:39.033008 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:39.033008 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 17:14:39.033008 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 17:14:39.033008 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 17:14:39.033008 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 17:14:39.033008 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 17:14:39.033008 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 17:14:39.033008 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 17:14:39.033008 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:39.033008 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 309/623] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 24 17:14:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:39.033008 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b5b0b-fd90-42bd-9f02-1057011e986b None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:39.073229 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befee11-436f-4f5c-9c86-38c08f2e02d8 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:39.108195 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f6a68-b100-4f26-bd04-681fc88d6256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:39.110023 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f6a68-b100-4f26-bd04-681fc88d6256 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:39.110447 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f6a68-b100-4f26-bd04-681fc88d6256 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:39.110897 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f6a68-b100-4f26-bd04-681fc88d6256 None admin] PATH_INFO: `/v3/users` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:39.111878 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f6a68-b100-4f26-bd04-681fc88d6256 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:39.112324 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f6a68-b100-4f26-bd04-681fc88d6256 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:39.113926 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f6a68-b100-4f26-bd04-681fc88d6256 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:39.138343 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 315/624] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Jun 24 17:14:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:39.138343 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f6a68-b100-4f26-bd04-681fc88d6256 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:39.144789 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b5b0b-fd90-42bd-9f02-1057011e986b None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:39.178749 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9e5c5-29c1-48f6-9478-a43ce11b18e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:39.179502 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9e5c5-29c1-48f6-9478-a43ce11b18e1 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:39.179841 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9e5c5-29c1-48f6-9478-a43ce11b18e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:39.180174 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9e5c5-29c1-48f6-9478-a43ce11b18e1 None admin] PATH_INFO: `/v3/projects` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:39.181017 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9e5c5-29c1-48f6-9478-a43ce11b18e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:39.181388 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9e5c5-29c1-48f6-9478-a43ce11b18e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:39.182904 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9e5c5-29c1-48f6-9478-a43ce11b18e1 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:39.195798 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 310/625] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 24 17:14:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:39.196771 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9e5c5-29c1-48f6-9478-a43ce11b18e1 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:39.248490 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f6a68-b100-4f26-bd04-681fc88d6256 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:39.256003 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:39.261506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:39.288565 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78999e-d74d-4b1f-a983-d1ca47ec8236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:39.289413 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78999e-d74d-4b1f-a983-d1ca47ec8236 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:39.289691 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78999e-d74d-4b1f-a983-d1ca47ec8236 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:39.289956 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78999e-d74d-4b1f-a983-d1ca47ec8236 None admin] PATH_INFO: `/v3/users` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:39.290803 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78999e-d74d-4b1f-a983-d1ca47ec8236 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:39.291126 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78999e-d74d-4b1f-a983-d1ca47ec8236 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:39.292556 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78999e-d74d-4b1f-a983-d1ca47ec8236 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:39.302311 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9e5c5-29c1-48f6-9478-a43ce11b18e1 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:39.310667 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 316/626] 10.222.0.15 () {56 vars in 1139 bytes} [Fri Jun 24 17:14:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:39.311733 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78999e-d74d-4b1f-a983-d1ca47ec8236 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:39.342470 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb7a1d-d6ba-406a-85ca-b8d9250226ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:39.343257 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb7a1d-d6ba-406a-85ca-b8d9250226ee None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:39.343529 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb7a1d-d6ba-406a-85ca-b8d9250226ee None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:39.343803 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb7a1d-d6ba-406a-85ca-b8d9250226ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:39.413926 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78999e-d74d-4b1f-a983-d1ca47ec8236 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:39.415129 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb7a1d-d6ba-406a-85ca-b8d9250226ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:39.416795 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb7a1d-d6ba-406a-85ca-b8d9250226ee None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:39.448101 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a43f1-514f-4bbc-b93e-2bbe71e5100c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:39.448770 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a43f1-514f-4bbc-b93e-2bbe71e5100c None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:39.449028 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a43f1-514f-4bbc-b93e-2bbe71e5100c None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:39.449310 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a43f1-514f-4bbc-b93e-2bbe71e5100c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:39.450122 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a43f1-514f-4bbc-b93e-2bbe71e5100c None admin] RBAC: Adding query filter params (role.id=a10baa216e4941ad8d168a1f7825a966, scope.project.id=fb66039441c14b96a79a30de4a833fa2, user.id=cb10c682def54ce9a22445a9b880d8ad) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:39.450419 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a43f1-514f-4bbc-b93e-2bbe71e5100c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:39.451870 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a43f1-514f-4bbc-b93e-2bbe71e5100c None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:39.457598 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 317/627] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:14:39 2022] GET /identity/v3/role_assignments?user.id=cb10c682def54ce9a22445a9b880d8ad&scope.project.id=fb66039441c14b96a79a30de4a833fa2&role.id=a10baa216e4941ad8d168a1f7825a966 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:39.458449 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a43f1-514f-4bbc-b93e-2bbe71e5100c None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:39.494524 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:39.502403 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:39.566731 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 311/628] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:14:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:14:39.568763 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb7a1d-d6ba-406a-85ca-b8d9250226ee None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:39.605512 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a43f1-514f-4bbc-b93e-2bbe71e5100c None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:39.661951 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0091d0-41ac-4216-8507-112fd473f287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:39.662651 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0091d0-41ac-4216-8507-112fd473f287 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:39.663098 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0091d0-41ac-4216-8507-112fd473f287 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:39.663371 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0091d0-41ac-4216-8507-112fd473f287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:39.680196 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb7a1d-d6ba-406a-85ca-b8d9250226ee None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:39.731436 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366a378-6bcc-4f91-8749-5344e1418797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:39.732237 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366a378-6bcc-4f91-8749-5344e1418797 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:39.732510 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366a378-6bcc-4f91-8749-5344e1418797 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:39.732779 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366a378-6bcc-4f91-8749-5344e1418797 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:39.745420 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366a378-6bcc-4f91-8749-5344e1418797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:39.746933 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366a378-6bcc-4f91-8749-5344e1418797 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:39.754560 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0091d0-41ac-4216-8507-112fd473f287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:39.756055 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0091d0-41ac-4216-8507-112fd473f287 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:39.772943 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-e366a378-6bcc-4f91-8749-5344e1418797 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:39.772943 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:39.772943 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:39.772943 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:39.772943 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:39.772943 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:39.772943 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:39.772943 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:39.772943 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:39.772943 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:39.772943 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:39.772943 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:39.772943 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:39.772943 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:39.772943 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:39.774065 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:39.774065 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:39.774065 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:39.774065 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:39.774065 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:39.774065 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:39.774065 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:39.774065 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:39.774065 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:39.774065 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:39.774065 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:39.774065 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:39.774065 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:39.774065 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:39.774065 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:39.774065 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:39.774065 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:39.775317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:39.775317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:39.775317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:39.775317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:39.775317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 312/629] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:39.783528 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366a378-6bcc-4f91-8749-5344e1418797 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:39.792121 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:39.798547 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:39.865102 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 318/630] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:14:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:14:39.875008 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0091d0-41ac-4216-8507-112fd473f287 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:39.902021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366a378-6bcc-4f91-8749-5344e1418797 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:39.940954 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640741ad-b73d-46ad-bb42-b36eccf3caae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:39.941619 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640741ad-b73d-46ad-bb42-b36eccf3caae None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:39.941890 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640741ad-b73d-46ad-bb42-b36eccf3caae None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:39.942156 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640741ad-b73d-46ad-bb42-b36eccf3caae None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:39.943226 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640741ad-b73d-46ad-bb42-b36eccf3caae None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:39.943226 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640741ad-b73d-46ad-bb42-b36eccf3caae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:39.944710 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640741ad-b73d-46ad-bb42-b36eccf3caae None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:39.957089 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 313/631] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:39.962675 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640741ad-b73d-46ad-bb42-b36eccf3caae None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:39.984980 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0091d0-41ac-4216-8507-112fd473f287 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:40.015405 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:40.022104 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e714c-4ce0-4c61-9149-417cbcdae467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:40.023245 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e714c-4ce0-4c61-9149-417cbcdae467 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:40.023667 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e714c-4ce0-4c61-9149-417cbcdae467 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:40.024080 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e714c-4ce0-4c61-9149-417cbcdae467 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:40.039991 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e714c-4ce0-4c61-9149-417cbcdae467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:40.041490 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e714c-4ce0-4c61-9149-417cbcdae467 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:40.057005 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:40.060412 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-6c9e714c-4ce0-4c61-9149-417cbcdae467 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:40.060412 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:40.060412 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:40.060412 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:40.060412 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:40.060412 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:40.060412 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:40.060412 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:40.060412 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:40.060412 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:40.060412 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:40.060412 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:40.060412 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:40.060412 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:40.060412 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:40.061283 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:40.061283 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:40.061283 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:40.061283 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:40.061283 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:40.061283 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:40.061283 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:40.061283 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:40.061283 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:40.061283 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:40.061283 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:40.061283 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:40.061283 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:40.061283 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:40.061283 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:40.061283 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:40.061283 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:40.062480 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:40.062480 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:40.062480 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:40.062480 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:40.062480 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 319/632] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:40.066980 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e714c-4ce0-4c61-9149-417cbcdae467 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:40.109287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640741ad-b73d-46ad-bb42-b36eccf3caae None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:40.154619 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881455f-63eb-4426-b34a-ecdaf22faef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:40.155823 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881455f-63eb-4426-b34a-ecdaf22faef7 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:40.156100 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881455f-63eb-4426-b34a-ecdaf22faef7 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:40.156368 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881455f-63eb-4426-b34a-ecdaf22faef7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:40.165765 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881455f-63eb-4426-b34a-ecdaf22faef7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:40.167543 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881455f-63eb-4426-b34a-ecdaf22faef7 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:40.176578 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e714c-4ce0-4c61-9149-417cbcdae467 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:40.186773 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-7881455f-63eb-4426-b34a-ecdaf22faef7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:40.186773 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:40.186773 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:40.186773 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:40.186773 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:40.186773 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:40.186773 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:40.186773 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:40.186773 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:40.186773 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:40.186773 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:40.186773 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:40.186773 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 17:14:40.186773 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 17:14:40.186773 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 17:14:40.187666 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 17:14:40.187666 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:40.187666 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:40.187666 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:40.187666 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:40.187666 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:40.187666 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:40.187666 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:40.187666 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:40.187666 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:40.187666 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:40.187666 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:40.187666 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:40.187666 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:40.187666 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:40.187666 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:40.187666 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:40.188528 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 17:14:40.188528 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 17:14:40.188528 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 17:14:40.188528 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 17:14:40.188528 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 17:14:40.188528 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 17:14:40.188528 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:40.188528 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:40.189381 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 314/633] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:40.194241 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881455f-63eb-4426-b34a-ecdaf22faef7 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:40.222828 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdf82d-f71e-4237-9270-c97bb3e19523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:40.223825 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdf82d-f71e-4237-9270-c97bb3e19523 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:40.224663 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdf82d-f71e-4237-9270-c97bb3e19523 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:40.225330 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdf82d-f71e-4237-9270-c97bb3e19523 None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:40.226709 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fdf82d-f71e-4237-9270-c97bb3e19523 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:40.227107 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fdf82d-f71e-4237-9270-c97bb3e19523 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:40.229244 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fdf82d-f71e-4237-9270-c97bb3e19523 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:40.249451 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 320/634] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:40.250881 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdf82d-f71e-4237-9270-c97bb3e19523 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:40.305229 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881455f-63eb-4426-b34a-ecdaf22faef7 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:40.309122 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:40.335425 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:40.342302 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b951a-d4b0-42f7-a239-90a8f314868b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:40.343382 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b951a-d4b0-42f7-a239-90a8f314868b None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:40.343382 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b951a-d4b0-42f7-a239-90a8f314868b None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:40.343577 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b951a-d4b0-42f7-a239-90a8f314868b None admin] PATH_INFO: `/v3/projects` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:40.344311 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b951a-d4b0-42f7-a239-90a8f314868b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:40.344616 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b951a-d4b0-42f7-a239-90a8f314868b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:40.346151 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b951a-d4b0-42f7-a239-90a8f314868b None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:40.367469 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 315/635] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 24 17:14:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:40.372001 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b951a-d4b0-42f7-a239-90a8f314868b None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:40.378341 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdf82d-f71e-4237-9270-c97bb3e19523 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:40.414642 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9574560-5c75-45b4-8b72-eeb1fd4c2a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:40.415827 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9574560-5c75-45b4-8b72-eeb1fd4c2a99 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:40.416297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9574560-5c75-45b4-8b72-eeb1fd4c2a99 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:40.416776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9574560-5c75-45b4-8b72-eeb1fd4c2a99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:40.423850 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9574560-5c75-45b4-8b72-eeb1fd4c2a99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:40.425518 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9574560-5c75-45b4-8b72-eeb1fd4c2a99 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:40.439473 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-d9574560-5c75-45b4-8b72-eeb1fd4c2a99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:40.439473 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:40.439473 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:40.439473 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:40.439473 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:40.439473 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:40.439473 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:40.439473 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:40.439473 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:40.439473 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:40.439473 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:40.439473 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:40.439473 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 17:14:40.439473 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 17:14:40.439473 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 17:14:40.440356 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 17:14:40.440356 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:40.440356 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:40.440356 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:40.440356 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:40.440356 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:40.440356 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:40.440356 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:40.440356 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:40.440356 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:40.440356 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:40.440356 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:40.440356 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:40.440356 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:40.440356 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:40.440356 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:40.440356 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:40.441222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 17:14:40.441222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 17:14:40.441222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 17:14:40.441222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 17:14:40.441222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 17:14:40.441222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 17:14:40.441222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:40.441222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:40.444839 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 321/636] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:40.450418 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9574560-5c75-45b4-8b72-eeb1fd4c2a99 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:40.478185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b951a-d4b0-42f7-a239-90a8f314868b None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:40.513857 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c9aa0-c77e-433b-95bd-f6cdaedfb8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:40.514513 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c9aa0-c77e-433b-95bd-f6cdaedfb8fd None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:40.514949 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c9aa0-c77e-433b-95bd-f6cdaedfb8fd None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:40.515170 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c9aa0-c77e-433b-95bd-f6cdaedfb8fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:40.516267 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c9aa0-c77e-433b-95bd-f6cdaedfb8fd None admin] RBAC: Adding query filter params (role.id=a10baa216e4941ad8d168a1f7825a966, scope.project.id=fb66039441c14b96a79a30de4a833fa2, user.id=aa7e8d98fb4744b7af95aa93050318d4) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:40.516376 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c9aa0-c77e-433b-95bd-f6cdaedfb8fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:40.517770 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c9aa0-c77e-433b-95bd-f6cdaedfb8fd None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:40.530929 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 316/637] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:14:40 2022] GET /identity/v3/role_assignments?user.id=aa7e8d98fb4744b7af95aa93050318d4&scope.project.id=fb66039441c14b96a79a30de4a833fa2&role.id=a10baa216e4941ad8d168a1f7825a966 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:40.560142 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9574560-5c75-45b4-8b72-eeb1fd4c2a99 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:40.563251 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:40.602281 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbaa6a1-48eb-4f58-bc66-8467238b09dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:40.603394 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbaa6a1-48eb-4f58-bc66-8467238b09dd None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:40.603866 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbaa6a1-48eb-4f58-bc66-8467238b09dd None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:40.604324 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbaa6a1-48eb-4f58-bc66-8467238b09dd None admin] PATH_INFO: `/v3/projects` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:40.605333 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbaa6a1-48eb-4f58-bc66-8467238b09dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:40.605828 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbaa6a1-48eb-4f58-bc66-8467238b09dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:40.607946 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbaa6a1-48eb-4f58-bc66-8467238b09dd None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:40.622245 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 322/638] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 24 17:14:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:40.628661 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c9aa0-c77e-433b-95bd-f6cdaedfb8fd None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:40.692368 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:40.743422 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c9aa0-c77e-433b-95bd-f6cdaedfb8fd None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:40.786668 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bacdac-f35d-4e8f-b53a-dde34dc84d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:40.787333 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bacdac-f35d-4e8f-b53a-dde34dc84d93 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:40.787616 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bacdac-f35d-4e8f-b53a-dde34dc84d93 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:40.787883 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bacdac-f35d-4e8f-b53a-dde34dc84d93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:40.788725 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bacdac-f35d-4e8f-b53a-dde34dc84d93 None admin] RBAC: Adding query filter params (role.id=a10baa216e4941ad8d168a1f7825a966, scope.project.id=fb66039441c14b96a79a30de4a833fa2, user.id=f6385ebfadc74598b3b024408455842e) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:40.789030 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bacdac-f35d-4e8f-b53a-dde34dc84d93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:40.790481 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bacdac-f35d-4e8f-b53a-dde34dc84d93 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:40.797230 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 317/639] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:14:40 2022] GET /identity/v3/role_assignments?user.id=f6385ebfadc74598b3b024408455842e&scope.project.id=fb66039441c14b96a79a30de4a833fa2&role.id=a10baa216e4941ad8d168a1f7825a966 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:41.275644 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe462a6-6ec1-4ce6-9f10-01cfe99e3bb0 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:41.275993 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe462a6-6ec1-4ce6-9f10-01cfe99e3bb0 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:41.276199 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe462a6-6ec1-4ce6-9f10-01cfe99e3bb0 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:41.277829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 323/640] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:41.283298 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa67c0-fd6d-4084-8421-8f8f42d5de1b None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:41.283525 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa67c0-fd6d-4084-8421-8f8f42d5de1b None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:41.283805 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa67c0-fd6d-4084-8421-8f8f42d5de1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:41.302643 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-49aa67c0-fd6d-4084-8421-8f8f42d5de1b None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:41.303868 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-49aa67c0-fd6d-4084-8421-8f8f42d5de1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:41.379966 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 318/641] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:41.405585 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe462a6-6ec1-4ce6-9f10-01cfe99e3bb0 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:41.531709 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe462a6-6ec1-4ce6-9f10-01cfe99e3bb0 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:41.568194 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca8ba7-ac14-41c6-9fdb-8e129b587ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:41.569340 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca8ba7-ac14-41c6-9fdb-8e129b587ac3 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:41.569881 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca8ba7-ac14-41c6-9fdb-8e129b587ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:41.570344 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca8ba7-ac14-41c6-9fdb-8e129b587ac3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:41.581214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca8ba7-ac14-41c6-9fdb-8e129b587ac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:41.589654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-37ca8ba7-ac14-41c6-9fdb-8e129b587ac3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:14:41.589654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:41.589654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:41.589654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:41.589654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:41.589654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:41.589654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:41.589654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:41.589654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:41.589654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:41.589654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:41.589654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:41.589654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:41.589654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:41.589654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:41.589654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:41.590711 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:41.590711 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:41.590711 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:41.590711 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:41.590711 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:41.590711 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:41.590711 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:41.590711 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:41.590711 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:41.590711 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:41.590711 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:41.590711 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:41.590711 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:41.590711 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:41.590711 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:41.590711 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:41.591619 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:41.591619 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:41.591619 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:41.591619 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:41.591619 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:41.591619 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:41.591619 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:41.591619 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:41.591619 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:41.591619 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:41.591619 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:14:41.591619 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:41.594486 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 324/642] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 24 17:14:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:41.602613 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa67c0-fd6d-4084-8421-8f8f42d5de1b None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:41.650932 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:41.707062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa67c0-fd6d-4084-8421-8f8f42d5de1b None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:41.742721 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948182eb-de95-490f-a04f-80ce23c3cea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:41.743390 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948182eb-de95-490f-a04f-80ce23c3cea9 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:41.743663 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948182eb-de95-490f-a04f-80ce23c3cea9 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:41.743928 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948182eb-de95-490f-a04f-80ce23c3cea9 None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:41.744735 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948182eb-de95-490f-a04f-80ce23c3cea9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:41.745039 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948182eb-de95-490f-a04f-80ce23c3cea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:41.746467 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948182eb-de95-490f-a04f-80ce23c3cea9 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:41.757249 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 319/643] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:14:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:41.763121 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca8ba7-ac14-41c6-9fdb-8e129b587ac3 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:41.790879 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:41.871424 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca8ba7-ac14-41c6-9fdb-8e129b587ac3 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:41.898864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d67298-014d-4e7e-9e01-e59c8f254e01 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:41.899210 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d67298-014d-4e7e-9e01-e59c8f254e01 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:41.899409 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d67298-014d-4e7e-9e01-e59c8f254e01 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:41.900996 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 320/644] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:41.905866 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd878c91-841f-4950-b8b0-45cdd75cb65a None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:41.906146 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd878c91-841f-4950-b8b0-45cdd75cb65a None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:41.906514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd878c91-841f-4950-b8b0-45cdd75cb65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:41.907249 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6365ca-4b71-4d09-9f09-738f98317eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:41.908047 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6365ca-4b71-4d09-9f09-738f98317eee None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:41.908321 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6365ca-4b71-4d09-9f09-738f98317eee None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:41.908593 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6365ca-4b71-4d09-9f09-738f98317eee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:41.919690 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6365ca-4b71-4d09-9f09-738f98317eee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:41.921140 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6365ca-4b71-4d09-9f09-738f98317eee None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:41.923417 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-cd878c91-841f-4950-b8b0-45cdd75cb65a None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:41.924580 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-cd878c91-841f-4950-b8b0-45cdd75cb65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:41.941217 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-ab6365ca-4b71-4d09-9f09-738f98317eee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:41.941217 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:41.941217 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:41.941217 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:41.941217 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:41.941217 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:41.941217 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:41.941217 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:41.941217 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:41.941217 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:41.941217 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:41.941217 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:41.941217 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:41.941217 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:41.941217 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:41.942146 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:41.942146 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:41.942146 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:41.942146 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:41.942146 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:41.942146 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:41.942146 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:41.942146 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:41.942146 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:41.942146 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:41.942146 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:41.942146 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:41.942146 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:41.942146 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:41.942146 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:41.942146 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:41.942146 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:41.943393 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:41.943393 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:41.943393 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:41.943393 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:41.943393 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 325/645] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:41.947997 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6365ca-4b71-4d09-9f09-738f98317eee None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:42.018993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 321/646] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:42.041941 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd878c91-841f-4950-b8b0-45cdd75cb65a None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:42.079698 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:42.087749 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:42.099457 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6365ca-4b71-4d09-9f09-738f98317eee None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:42.138190 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc9eb6-0585-454d-b3d7-c9c4d2de9d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:42.138815 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc9eb6-0585-454d-b3d7-c9c4d2de9d75 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:42.139093 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc9eb6-0585-454d-b3d7-c9c4d2de9d75 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:42.139366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc9eb6-0585-454d-b3d7-c9c4d2de9d75 None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:42.140299 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc9eb6-0585-454d-b3d7-c9c4d2de9d75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:42.140494 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc9eb6-0585-454d-b3d7-c9c4d2de9d75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:42.142058 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc9eb6-0585-454d-b3d7-c9c4d2de9d75 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:42.160660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 326/647] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:42.162721 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc9eb6-0585-454d-b3d7-c9c4d2de9d75 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:42.172219 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd878c91-841f-4950-b8b0-45cdd75cb65a None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:42.207320 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b640c6-0001-425a-b37d-9972b8943e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:42.208583 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b640c6-0001-425a-b37d-9972b8943e7f None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:42.209076 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b640c6-0001-425a-b37d-9972b8943e7f None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:42.209637 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b640c6-0001-425a-b37d-9972b8943e7f None admin] PATH_INFO: `/v3/services/image` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:42.210478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b640c6-0001-425a-b37d-9972b8943e7f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:42.212097 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b640c6-0001-425a-b37d-9972b8943e7f None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:42.226266 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-d3b640c6-0001-425a-b37d-9972b8943e7f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 17:14:42.226266 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:42.226266 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 17:14:42.226266 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 17:14:42.226266 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 17:14:42.226266 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 17:14:42.226266 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 17:14:42.226266 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:14:42.226266 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 17:14:42.226266 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:42.226266 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:14:42.226266 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:42.226266 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:42.226266 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:42.226266 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:42.226266 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:42.226266 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:42.227478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:42.227478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:42.227478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:42.227478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:42.227478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:42.227478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:42.227478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 17:14:42.227478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 17:14:42.227478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 17:14:42.227478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 17:14:42.227478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:42.227478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:42.227478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:42.227478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:42.227478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:42.227478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:42.228433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:42.228433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:42.228433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:42.228433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:42.228433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:42.228433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:42.228433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:42.228433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:42.228433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:42.228433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:42.228433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 17:14:42.228433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:14:42.228433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 17:14:42.228433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:42.234806 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 322/648] 10.222.0.15 () {56 vars in 1105 bytes} [Fri Jun 24 17:14:42 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:14:42.236992 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b640c6-0001-425a-b37d-9972b8943e7f None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:42.271230 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc9eb6-0585-454d-b3d7-c9c4d2de9d75 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:42.309743 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975ba91-ed14-41d8-89f1-b4230ab47f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:42.309997 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975ba91-ed14-41d8-89f1-b4230ab47f7c None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:42.310255 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975ba91-ed14-41d8-89f1-b4230ab47f7c None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:42.310509 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975ba91-ed14-41d8-89f1-b4230ab47f7c None admin] PATH_INFO: `/v3/users/nova` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:42.313440 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:42.319535 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975ba91-ed14-41d8-89f1-b4230ab47f7c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:42.321421 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975ba91-ed14-41d8-89f1-b4230ab47f7c None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:42.342044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-8975ba91-ed14-41d8-89f1-b4230ab47f7c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 17:14:42.342044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:42.342044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:42.342044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:42.342044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:42.342044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:42.342044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:42.342044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:42.342044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:42.342044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:42.342044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:42.342044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:42.342044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 17:14:42.342044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 17:14:42.342044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 17:14:42.342044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 17:14:42.343297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:42.343297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:42.343297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 17:14:42.343297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:42.343297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 17:14:42.343297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:42.343297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:42.343297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:42.343297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:42.343297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:42.343297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:42.343297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:42.343297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:42.343297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:42.343297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:42.343297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:42.343297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:42.343297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:42.344247 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:42.344247 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:42.344247 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 17:14:42.344247 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 17:14:42.344247 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 17:14:42.344247 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 17:14:42.344247 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 17:14:42.344247 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 17:14:42.344247 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 17:14:42.344247 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:42.346303 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b640c6-0001-425a-b37d-9972b8943e7f None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:42.348009 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 327/649] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Jun 24 17:14:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:42.350846 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975ba91-ed14-41d8-89f1-b4230ab47f7c None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:42.352548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:42.398128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba733e-1d90-43b4-b5ee-f1f4adb9bad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:42.399374 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba733e-1d90-43b4-b5ee-f1f4adb9bad8 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:42.399647 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba733e-1d90-43b4-b5ee-f1f4adb9bad8 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:42.399918 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba733e-1d90-43b4-b5ee-f1f4adb9bad8 None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:42.400647 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba733e-1d90-43b4-b5ee-f1f4adb9bad8 None admin] RBAC: Adding query filter params (name=image) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:42.400946 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba733e-1d90-43b4-b5ee-f1f4adb9bad8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:42.402329 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba733e-1d90-43b4-b5ee-f1f4adb9bad8 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:42.411876 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 323/650] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:42.412908 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba733e-1d90-43b4-b5ee-f1f4adb9bad8 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:42.488490 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975ba91-ed14-41d8-89f1-b4230ab47f7c None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:42.525443 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba733e-1d90-43b4-b5ee-f1f4adb9bad8 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:42.526240 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa72c64-1236-4419-ae4a-4713d11fe55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:42.526940 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa72c64-1236-4419-ae4a-4713d11fe55b None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:42.527214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa72c64-1236-4419-ae4a-4713d11fe55b None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:42.527479 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa72c64-1236-4419-ae4a-4713d11fe55b None admin] PATH_INFO: `/v3/users` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:42.528307 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa72c64-1236-4419-ae4a-4713d11fe55b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:42.528604 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa72c64-1236-4419-ae4a-4713d11fe55b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:42.530183 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa72c64-1236-4419-ae4a-4713d11fe55b None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:42.554509 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 328/651] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Jun 24 17:14:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:42.555453 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa72c64-1236-4419-ae4a-4713d11fe55b None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:42.569161 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef3f26-f66f-416f-a898-d2eb17b7fb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:42.570412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef3f26-f66f-416f-a898-d2eb17b7fb33 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:42.570918 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef3f26-f66f-416f-a898-d2eb17b7fb33 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:42.571627 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef3f26-f66f-416f-a898-d2eb17b7fb33 None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:42.573010 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef3f26-f66f-416f-a898-d2eb17b7fb33 None admin] RBAC: Adding query filter params (type=image) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:42.573788 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef3f26-f66f-416f-a898-d2eb17b7fb33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:42.575989 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef3f26-f66f-416f-a898-d2eb17b7fb33 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:42.584679 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 324/652] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:42 2022] GET /identity/v3/services?type=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:42.627949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:42.678505 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa72c64-1236-4419-ae4a-4713d11fe55b None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:42.720391 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26393955-a1d3-4e64-83aa-932a4d8a3347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:42.721074 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26393955-a1d3-4e64-83aa-932a4d8a3347 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:42.721351 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26393955-a1d3-4e64-83aa-932a4d8a3347 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:42.721619 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26393955-a1d3-4e64-83aa-932a4d8a3347 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:42.796915 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26393955-a1d3-4e64-83aa-932a4d8a3347 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:42.798379 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26393955-a1d3-4e64-83aa-932a4d8a3347 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:42.855505 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:42.903534 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 329/653] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:14:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 17:14:42.909057 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef3f26-f66f-416f-a898-d2eb17b7fb33 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:42.941702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:42.963373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2f725-7923-4fec-826b-fc72fd8c433c None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:42.963799 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2f725-7923-4fec-826b-fc72fd8c433c None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:42.964163 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2f725-7923-4fec-826b-fc72fd8c433c None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:42.965903 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 330/654] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 17:14:42.971753 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6312507-6065-405d-988e-97577efedaa7 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:42.972161 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6312507-6065-405d-988e-97577efedaa7 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:42.972529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6312507-6065-405d-988e-97577efedaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:42.991012 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-b6312507-6065-405d-988e-97577efedaa7 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:42.992329 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-b6312507-6065-405d-988e-97577efedaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:43.027264 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef3f26-f66f-416f-a898-d2eb17b7fb33 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:43.069501 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668086ba-8685-48a3-bca9-154304e0945f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:43.070720 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668086ba-8685-48a3-bca9-154304e0945f None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:43.071190 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668086ba-8685-48a3-bca9-154304e0945f None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:43.071671 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668086ba-8685-48a3-bca9-154304e0945f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:43.084568 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668086ba-8685-48a3-bca9-154304e0945f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:43.090723 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 331/655] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:43.090864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668086ba-8685-48a3-bca9-154304e0945f None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:43.109204 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6312507-6065-405d-988e-97577efedaa7 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:43.110078 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-668086ba-8685-48a3-bca9-154304e0945f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:43.110078 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:43.110078 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:43.110078 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:43.110078 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:43.110078 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:43.110078 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:43.110078 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:43.110078 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:43.110078 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:43.110078 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:43.110078 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:43.110078 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:43.110078 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:43.110078 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:43.111147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:43.111147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:43.111147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:43.111147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:43.111147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:43.111147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:43.111147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:43.111147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:43.111147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:43.111147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:43.111147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:43.111147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:43.111147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:43.111147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:43.111147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:43.111147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:43.111147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:43.112258 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:43.112258 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:43.112258 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:43.112258 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:43.115084 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 325/656] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:43.123848 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668086ba-8685-48a3-bca9-154304e0945f None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:43.207351 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:43.224868 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6312507-6065-405d-988e-97577efedaa7 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:43.231373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:43.250227 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668086ba-8685-48a3-bca9-154304e0945f None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:43.262348 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fd50a-c197-491d-9d97-ee5a46613c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:43.263464 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fd50a-c197-491d-9d97-ee5a46613c69 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:43.263800 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fd50a-c197-491d-9d97-ee5a46613c69 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:43.264133 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fd50a-c197-491d-9d97-ee5a46613c69 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:43.264857 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9fd50a-c197-491d-9d97-ee5a46613c69 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:43.266312 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9fd50a-c197-491d-9d97-ee5a46613c69 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:43.282038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-3c9fd50a-c197-491d-9d97-ee5a46613c69 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 17:14:43.282038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:43.282038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 17:14:43.282038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 17:14:43.282038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 17:14:43.282038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 17:14:43.282038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 17:14:43.282038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:14:43.282038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 17:14:43.282038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:43.282038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:14:43.282038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:43.282038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:43.282038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:43.282038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:43.282038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:43.283390 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:43.283390 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:43.283390 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:43.283390 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:43.283390 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:43.283390 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:43.283390 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:43.283390 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 17:14:43.283390 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 17:14:43.283390 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 17:14:43.283390 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 17:14:43.283390 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:43.283390 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:43.283390 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:43.283390 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:43.283390 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:43.284201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:43.284201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:43.284201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:43.284201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:43.284201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:43.284201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:43.284201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:43.284201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:43.284201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:43.284201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:43.284201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:43.284201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 17:14:43.284201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:14:43.284201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 17:14:43.284201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:43.284201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 332/657] 10.222.0.15 () {56 vars in 1129 bytes} [Fri Jun 24 17:14:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:14:43.285382 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87111b4f-0266-4f17-b41b-a2509b7f7255 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:43.285382 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87111b4f-0266-4f17-b41b-a2509b7f7255 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:43.285382 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87111b4f-0266-4f17-b41b-a2509b7f7255 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:43.290428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 333/658] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:43.290428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87111b4f-0266-4f17-b41b-a2509b7f7255 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:43.294685 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cafd9-8ab1-419c-94fd-c4ab4777a7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:43.295357 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cafd9-8ab1-419c-94fd-c4ab4777a7ec None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:43.295640 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cafd9-8ab1-419c-94fd-c4ab4777a7ec None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:43.295913 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cafd9-8ab1-419c-94fd-c4ab4777a7ec None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:43.296638 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cafd9-8ab1-419c-94fd-c4ab4777a7ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:43.296943 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cafd9-8ab1-419c-94fd-c4ab4777a7ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:43.298319 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cafd9-8ab1-419c-94fd-c4ab4777a7ec None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:43.311626 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 326/659] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:43.313317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921b792-e813-47f2-b023-4d2a89a15f38 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:43.313655 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921b792-e813-47f2-b023-4d2a89a15f38 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:43.313988 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921b792-e813-47f2-b023-4d2a89a15f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:43.331904 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-d921b792-e813-47f2-b023-4d2a89a15f38 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:43.333527 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-d921b792-e813-47f2-b023-4d2a89a15f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:43.398978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87111b4f-0266-4f17-b41b-a2509b7f7255 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:43.404181 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 327/660] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:43.415468 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921b792-e813-47f2-b023-4d2a89a15f38 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:43.437686 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f27e8e-6d1c-4495-b4d0-a356da83442a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:43.438347 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f27e8e-6d1c-4495-b4d0-a356da83442a None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:43.438695 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f27e8e-6d1c-4495-b4d0-a356da83442a None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:43.438966 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f27e8e-6d1c-4495-b4d0-a356da83442a None admin] PATH_INFO: `/v3/services` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:43.439911 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f27e8e-6d1c-4495-b4d0-a356da83442a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:43.440084 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f27e8e-6d1c-4495-b4d0-a356da83442a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:43.441525 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f27e8e-6d1c-4495-b4d0-a356da83442a None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:43.447244 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 334/661] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Jun 24 17:14:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:43.448139 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f27e8e-6d1c-4495-b4d0-a356da83442a None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:43.464862 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:43.500261 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:43.525269 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921b792-e813-47f2-b023-4d2a89a15f38 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:43.554536 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f27e8e-6d1c-4495-b4d0-a356da83442a None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:43.559143 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ca048-b66a-4168-83e6-077e049635cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:43.559938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ca048-b66a-4168-83e6-077e049635cd None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:43.560213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ca048-b66a-4168-83e6-077e049635cd None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:43.560481 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ca048-b66a-4168-83e6-077e049635cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:43.567278 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ca048-b66a-4168-83e6-077e049635cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:43.568766 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ca048-b66a-4168-83e6-077e049635cd None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:43.582515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-374ca048-b66a-4168-83e6-077e049635cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:43.582515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:43.582515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:43.582515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:43.582515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:43.582515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:43.582515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:43.582515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:43.582515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:43.582515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:43.582515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:43.582515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:43.582515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 17:14:43.582515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 17:14:43.582515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 17:14:43.583572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 17:14:43.583572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:43.583572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:43.583572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:43.583572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:43.583572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:43.583572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:43.583572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:43.583572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:43.583572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:43.583572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:43.583572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:43.583572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:43.583572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:43.583572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:43.583572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:43.583572 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:43.584447 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 17:14:43.584447 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 17:14:43.584447 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 17:14:43.584447 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 17:14:43.584447 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 17:14:43.584447 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 17:14:43.584447 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:43.584447 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:43.584447 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 328/662] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:43.584924 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ca048-b66a-4168-83e6-077e049635cd None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:43.595195 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cea08-c99d-4e40-8334-b479f6bfdfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:43.595999 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cea08-c99d-4e40-8334-b479f6bfdfd1 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:43.596299 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cea08-c99d-4e40-8334-b479f6bfdfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:43.596899 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cea08-c99d-4e40-8334-b479f6bfdfd1 None admin] PATH_INFO: `/v3/services/network` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:43.597556 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cea08-c99d-4e40-8334-b479f6bfdfd1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:43.599816 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cea08-c99d-4e40-8334-b479f6bfdfd1 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:43.611880 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-568cea08-c99d-4e40-8334-b479f6bfdfd1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 17:14:43.611880 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:43.611880 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 17:14:43.611880 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 17:14:43.611880 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 17:14:43.611880 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 17:14:43.611880 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 17:14:43.611880 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:14:43.611880 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 17:14:43.611880 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:43.611880 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:14:43.611880 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:43.611880 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:43.611880 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:43.611880 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:43.611880 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:43.611880 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:43.612831 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:43.612831 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:43.612831 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:43.612831 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:43.612831 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:43.612831 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:43.612831 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 17:14:43.612831 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 17:14:43.612831 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 17:14:43.612831 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 17:14:43.612831 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:43.612831 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:43.612831 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:43.612831 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:43.612831 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:43.612831 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:43.613690 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:43.613690 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:43.613690 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:43.613690 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:43.613690 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:43.613690 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:43.613690 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:43.613690 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:43.613690 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:43.613690 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:43.613690 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 17:14:43.613690 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:14:43.613690 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 17:14:43.613690 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:43.613690 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 335/663] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:43 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:43.615033 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cea08-c99d-4e40-8334-b479f6bfdfd1 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:43.693412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ca048-b66a-4168-83e6-077e049635cd None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:43.696974 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:43.722214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cea08-c99d-4e40-8334-b479f6bfdfd1 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:43.732511 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00ab23-4d9b-4970-b0e5-2d08c5d32ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:43.733936 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00ab23-4d9b-4970-b0e5-2d08c5d32ccd None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:43.734419 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00ab23-4d9b-4970-b0e5-2d08c5d32ccd None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:43.734888 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00ab23-4d9b-4970-b0e5-2d08c5d32ccd None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:43.736232 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00ab23-4d9b-4970-b0e5-2d08c5d32ccd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:43.736716 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00ab23-4d9b-4970-b0e5-2d08c5d32ccd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:43.738679 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00ab23-4d9b-4970-b0e5-2d08c5d32ccd None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:43.740602 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:43.745009 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 329/664] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Jun 24 17:14:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:43.745818 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00ab23-4d9b-4970-b0e5-2d08c5d32ccd None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:43.774810 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bf56f-6936-480b-ab3f-25dcf0644bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:43.776314 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bf56f-6936-480b-ab3f-25dcf0644bb2 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:43.777078 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bf56f-6936-480b-ab3f-25dcf0644bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:43.777556 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bf56f-6936-480b-ab3f-25dcf0644bb2 None admin] PATH_INFO: `/v3/projects` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:43.779172 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2bf56f-6936-480b-ab3f-25dcf0644bb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:43.779741 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2bf56f-6936-480b-ab3f-25dcf0644bb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:43.782026 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2bf56f-6936-480b-ab3f-25dcf0644bb2 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:43.800708 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 336/665] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 24 17:14:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:43.806954 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bf56f-6936-480b-ab3f-25dcf0644bb2 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:43.868234 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00ab23-4d9b-4970-b0e5-2d08c5d32ccd None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:43.918611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78995a6e-1888-4c85-9576-a7e15dac310a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:43.918611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78995a6e-1888-4c85-9576-a7e15dac310a None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:43.918611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78995a6e-1888-4c85-9576-a7e15dac310a None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:43.918611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78995a6e-1888-4c85-9576-a7e15dac310a None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:43.919556 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78995a6e-1888-4c85-9576-a7e15dac310a None admin] RBAC: Adding query filter params (name=network) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:43.919556 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78995a6e-1888-4c85-9576-a7e15dac310a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:43.919556 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78995a6e-1888-4c85-9576-a7e15dac310a None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:43.923687 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 330/666] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 24 17:14:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:43.930871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78995a6e-1888-4c85-9576-a7e15dac310a None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:43.955159 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bf56f-6936-480b-ab3f-25dcf0644bb2 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:44.000666 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489cf51-fc9c-4b66-8593-7376dda35189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:44.002047 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489cf51-fc9c-4b66-8593-7376dda35189 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:44.002429 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489cf51-fc9c-4b66-8593-7376dda35189 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:44.002882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489cf51-fc9c-4b66-8593-7376dda35189 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:44.003954 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489cf51-fc9c-4b66-8593-7376dda35189 None admin] RBAC: Adding query filter params (role.id=ae295b7c396a4e559ecd6d574f097d4a, scope.project.id=fb66039441c14b96a79a30de4a833fa2, user.id=9ff8200a750d49b1830c58f279e569c3) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:44.004269 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489cf51-fc9c-4b66-8593-7376dda35189 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:44.006084 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489cf51-fc9c-4b66-8593-7376dda35189 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:44.010400 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:44.014024 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:44.015586 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 337/667] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:14:43 2022] GET /identity/v3/role_assignments?user.id=9ff8200a750d49b1830c58f279e569c3&scope.project.id=fb66039441c14b96a79a30de4a833fa2&role.id=ae295b7c396a4e559ecd6d574f097d4a => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:44.078351 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78995a6e-1888-4c85-9576-a7e15dac310a None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:44.116233 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511143d-4ec7-437c-9956-5226c65f8f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:44.116912 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511143d-4ec7-437c-9956-5226c65f8f68 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:44.117186 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511143d-4ec7-437c-9956-5226c65f8f68 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:44.117452 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511143d-4ec7-437c-9956-5226c65f8f68 None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:44.118161 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e511143d-4ec7-437c-9956-5226c65f8f68 None admin] RBAC: Adding query filter params (type=network) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:44.118458 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e511143d-4ec7-437c-9956-5226c65f8f68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:44.119905 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e511143d-4ec7-437c-9956-5226c65f8f68 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:44.130687 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 331/668] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 24 17:14:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:44.980789 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58469ce-3177-4a79-a12c-b8eadd86f0ac None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:44.981324 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58469ce-3177-4a79-a12c-b8eadd86f0ac None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:44.981324 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58469ce-3177-4a79-a12c-b8eadd86f0ac None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:44.982869 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 338/669] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:44.988190 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c9585-45e1-4af0-8152-6bd5773f45a0 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:44.989017 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c9585-45e1-4af0-8152-6bd5773f45a0 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:44.989489 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c9585-45e1-4af0-8152-6bd5773f45a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:45.006770 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-e25c9585-45e1-4af0-8152-6bd5773f45a0 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:45.008274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-e25c9585-45e1-4af0-8152-6bd5773f45a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:45.088051 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 332/670] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:45.111673 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58469ce-3177-4a79-a12c-b8eadd86f0ac None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:45.228867 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58469ce-3177-4a79-a12c-b8eadd86f0ac None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:45.264415 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3d11a-331e-4a73-a0bc-a8851fe818e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:45.265604 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3d11a-331e-4a73-a0bc-a8851fe818e2 None admin] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:45.266081 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3d11a-331e-4a73-a0bc-a8851fe818e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:45.266541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3d11a-331e-4a73-a0bc-a8851fe818e2 None admin] PATH_INFO: `/v3/services` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:45.267549 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3d11a-331e-4a73-a0bc-a8851fe818e2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:45.269190 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3d11a-331e-4a73-a0bc-a8851fe818e2 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:45.290417 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 339/671] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 24 17:14:45 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:14:46.128074 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866abf3-e94a-4678-92b4-4ed5f09d05c1 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:46.129062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866abf3-e94a-4678-92b4-4ed5f09d05c1 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:46.129568 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866abf3-e94a-4678-92b4-4ed5f09d05c1 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:46.131468 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 333/672] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:46.139101 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7509b79-ba8d-4fec-804e-f261db02b83c None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:46.139959 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7509b79-ba8d-4fec-804e-f261db02b83c None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:46.140424 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7509b79-ba8d-4fec-804e-f261db02b83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:46.158090 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-f7509b79-ba8d-4fec-804e-f261db02b83c None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:46.159687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-f7509b79-ba8d-4fec-804e-f261db02b83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:46.221199 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:46.245303 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 340/673] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:46 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:46.270265 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866abf3-e94a-4678-92b4-4ed5f09d05c1 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:46.331977 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:46.383287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866abf3-e94a-4678-92b4-4ed5f09d05c1 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:46.427818 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87897e6e-4994-414c-b25c-e204ff6adb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:46.428769 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87897e6e-4994-414c-b25c-e204ff6adb3f None admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:46.429189 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87897e6e-4994-414c-b25c-e204ff6adb3f None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:46.429600 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87897e6e-4994-414c-b25c-e204ff6adb3f None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:46.430488 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87897e6e-4994-414c-b25c-e204ff6adb3f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:46.432050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87897e6e-4994-414c-b25c-e204ff6adb3f None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:46.450977 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 334/674] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 24 17:14:46 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:14:46.498898 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e6137-ae8f-4961-a25d-6e8316c9787a None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:46.499361 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e6137-ae8f-4961-a25d-6e8316c9787a None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:46.499726 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e6137-ae8f-4961-a25d-6e8316c9787a None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:46.501469 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 341/675] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:46.507979 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941b24a-b626-4b7c-bedb-0845c69dbd0c None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:46.508260 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941b24a-b626-4b7c-bedb-0845c69dbd0c None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:46.508529 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941b24a-b626-4b7c-bedb-0845c69dbd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:46.513993 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c27b8-e1b0-4e2d-b0d1-dc1659c8621e None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:46.514268 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c27b8-e1b0-4e2d-b0d1-dc1659c8621e None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:46.514624 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c27b8-e1b0-4e2d-b0d1-dc1659c8621e None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:46.516159 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 342/676] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 17:14:46.524117 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717462a-70e8-424f-9d4e-2c6570725929 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:46.524754 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717462a-70e8-424f-9d4e-2c6570725929 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:46.525227 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717462a-70e8-424f-9d4e-2c6570725929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:46.531690 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-5941b24a-b626-4b7c-bedb-0845c69dbd0c None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:46.532911 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-5941b24a-b626-4b7c-bedb-0845c69dbd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:46.547511 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-5717462a-70e8-424f-9d4e-2c6570725929 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:46.548958 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-5717462a-70e8-424f-9d4e-2c6570725929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:46.641986 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 335/677] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:46 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 17:14:46.650611 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 343/678] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:46 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 17:14:46.666548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941b24a-b626-4b7c-bedb-0845c69dbd0c None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:46.674679 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717462a-70e8-424f-9d4e-2c6570725929 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:46.717060 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:46.787849 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717462a-70e8-424f-9d4e-2c6570725929 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:46.788094 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941b24a-b626-4b7c-bedb-0845c69dbd0c None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:46.801795 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:46.823869 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658f03f-e391-42d8-9cfc-8df1124b45b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:46.824649 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658f03f-e391-42d8-9cfc-8df1124b45b4 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:46.824925 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658f03f-e391-42d8-9cfc-8df1124b45b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:46.825189 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658f03f-e391-42d8-9cfc-8df1124b45b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:46.835802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50186f1-7366-402e-889e-1aa5aabede68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:46.836066 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658f03f-e391-42d8-9cfc-8df1124b45b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:46.836898 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50186f1-7366-402e-889e-1aa5aabede68 None admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:46.837318 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50186f1-7366-402e-889e-1aa5aabede68 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:46.837829 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50186f1-7366-402e-889e-1aa5aabede68 None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:46.838727 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50186f1-7366-402e-889e-1aa5aabede68 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:46.840251 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50186f1-7366-402e-889e-1aa5aabede68 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:46.843829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-d658f03f-e391-42d8-9cfc-8df1124b45b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:14:46.843829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:46.843829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:46.843829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:46.843829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:46.843829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:46.843829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:46.843829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:46.843829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:46.843829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:46.843829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:46.843829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:46.843829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:46.843829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:46.843829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:46.843829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:46.844972 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:46.844972 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:46.844972 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:46.844972 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:46.844972 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:46.844972 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:46.844972 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:46.844972 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:46.844972 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:46.844972 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:46.844972 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:46.844972 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:46.844972 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:46.844972 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:46.844972 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:46.844972 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:46.845964 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:46.845964 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:46.845964 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:46.845964 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:46.845964 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:46.845964 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:46.845964 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:46.845964 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:46.845964 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:46.845964 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:46.845964 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:14:46.845964 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:46.850433 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 344/679] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 24 17:14:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:14:46.851666 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658f03f-e391-42d8-9cfc-8df1124b45b4 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:46.867071 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 336/680] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 24 17:14:46 2022] POST /identity/v3/services => generated 240 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:14:46.973073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658f03f-e391-42d8-9cfc-8df1124b45b4 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:47.017852 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a934563-7a4b-452d-8f5d-d49aa5c0e666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:47.018977 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a934563-7a4b-452d-8f5d-d49aa5c0e666 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:47.019464 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a934563-7a4b-452d-8f5d-d49aa5c0e666 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:47.020335 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a934563-7a4b-452d-8f5d-d49aa5c0e666 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:47.021454 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a934563-7a4b-452d-8f5d-d49aa5c0e666 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:47.021958 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a934563-7a4b-452d-8f5d-d49aa5c0e666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:47.023627 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a934563-7a4b-452d-8f5d-d49aa5c0e666 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:47.034082 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 345/681] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:14:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:47.040309 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50186f1-7366-402e-889e-1aa5aabede68 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:47.159394 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50186f1-7366-402e-889e-1aa5aabede68 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:47.161370 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:47.196751 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee20839-e87c-4f13-ae8f-d256aabdcb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:47.197548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee20839-e87c-4f13-ae8f-d256aabdcb9e None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:47.197821 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee20839-e87c-4f13-ae8f-d256aabdcb9e None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:47.198085 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee20839-e87c-4f13-ae8f-d256aabdcb9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:47.209087 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee20839-e87c-4f13-ae8f-d256aabdcb9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:47.210549 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee20839-e87c-4f13-ae8f-d256aabdcb9e None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:47.230386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-7ee20839-e87c-4f13-ae8f-d256aabdcb9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:47.230386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:47.230386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:47.230386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:47.230386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:47.230386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:47.230386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:47.230386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:47.230386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:47.230386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:47.230386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:47.230386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:47.230386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:47.230386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:47.230386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:47.231305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:47.231305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:47.231305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:47.231305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:47.231305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:47.231305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:47.231305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:47.231305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:47.231305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:47.231305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:47.231305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:47.231305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:47.231305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:47.231305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:47.231305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:47.231305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:47.231305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:47.232191 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:47.232191 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:47.232191 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:47.232191 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:47.236185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 337/682] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:47.237538 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a934563-7a4b-452d-8f5d-d49aa5c0e666 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:47.270082 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:47.341807 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a934563-7a4b-452d-8f5d-d49aa5c0e666 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:47.376991 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab7eb2-c878-41e4-baff-cd874d6ff1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:47.377654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab7eb2-c878-41e4-baff-cd874d6ff1c0 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:47.377933 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab7eb2-c878-41e4-baff-cd874d6ff1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:47.378206 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab7eb2-c878-41e4-baff-cd874d6ff1c0 None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:47.378963 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab7eb2-c878-41e4-baff-cd874d6ff1c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:47.379321 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab7eb2-c878-41e4-baff-cd874d6ff1c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:47.380752 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab7eb2-c878-41e4-baff-cd874d6ff1c0 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:47.393554 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 346/683] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:47.399291 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee20839-e87c-4f13-ae8f-d256aabdcb9e None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:47.508396 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee20839-e87c-4f13-ae8f-d256aabdcb9e None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:47.544255 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c412dba-a539-4497-bfcd-ce8fb98e1e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:47.545065 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c412dba-a539-4497-bfcd-ce8fb98e1e05 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:47.545358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c412dba-a539-4497-bfcd-ce8fb98e1e05 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:47.545784 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c412dba-a539-4497-bfcd-ce8fb98e1e05 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:47.555878 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c412dba-a539-4497-bfcd-ce8fb98e1e05 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:47.557412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c412dba-a539-4497-bfcd-ce8fb98e1e05 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:47.572702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-1c412dba-a539-4497-bfcd-ce8fb98e1e05 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 17:14:47.572702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:47.572702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:47.572702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:47.572702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:47.572702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:47.572702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:47.572702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:47.572702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:47.572702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:47.572702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:47.572702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:47.572702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 17:14:47.572702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 17:14:47.572702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 17:14:47.572702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 17:14:47.574909 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:47.574909 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:47.574909 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 17:14:47.574909 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:47.574909 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 17:14:47.574909 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:47.574909 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:47.574909 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:47.574909 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:47.574909 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:47.574909 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:47.574909 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:47.574909 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:47.574909 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:47.574909 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:47.574909 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:47.574909 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:47.574909 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:47.577128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:47.577128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:47.577128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 17:14:47.577128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 17:14:47.577128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 17:14:47.577128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 17:14:47.577128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 17:14:47.577128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 17:14:47.577128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 17:14:47.577128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:47.577128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 338/684] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Jun 24 17:14:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:47.583710 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab7eb2-c878-41e4-baff-cd874d6ff1c0 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:47.646215 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beece9cd-0011-4fc9-bdda-3223c9762be1 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:47.646491 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beece9cd-0011-4fc9-bdda-3223c9762be1 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:47.646792 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beece9cd-0011-4fc9-bdda-3223c9762be1 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:47.648310 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 339/685] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 17:14:47.655235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4e95d-45ee-4545-8f74-25390f0c5aa5 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:47.655780 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4e95d-45ee-4545-8f74-25390f0c5aa5 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:47.656064 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4e95d-45ee-4545-8f74-25390f0c5aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:47.678933 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-b6f4e95d-45ee-4545-8f74-25390f0c5aa5 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:47.680397 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:47.681108 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-b6f4e95d-45ee-4545-8f74-25390f0c5aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:47.690696 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab7eb2-c878-41e4-baff-cd874d6ff1c0 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:47.694690 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:47.728299 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962005fa-a39b-498b-a2e3-5d136e05856a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:47.729284 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962005fa-a39b-498b-a2e3-5d136e05856a None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:47.729729 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962005fa-a39b-498b-a2e3-5d136e05856a None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:47.730195 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962005fa-a39b-498b-a2e3-5d136e05856a None admin] PATH_INFO: `/v3/users` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:47.731304 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962005fa-a39b-498b-a2e3-5d136e05856a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:47.731821 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962005fa-a39b-498b-a2e3-5d136e05856a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:47.733530 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962005fa-a39b-498b-a2e3-5d136e05856a None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:47.753403 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 347/686] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Jun 24 17:14:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:47.759386 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962005fa-a39b-498b-a2e3-5d136e05856a None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:47.770732 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 340/687] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:47 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 17:14:47.797167 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4e95d-45ee-4545-8f74-25390f0c5aa5 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:47.894380 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962005fa-a39b-498b-a2e3-5d136e05856a None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:47.921857 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4e95d-45ee-4545-8f74-25390f0c5aa5 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:47.938391 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0e9cc-5ae6-4405-a65e-af579d14d2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:47.939871 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0e9cc-5ae6-4405-a65e-af579d14d2a6 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:47.940183 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0e9cc-5ae6-4405-a65e-af579d14d2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:47.940458 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0e9cc-5ae6-4405-a65e-af579d14d2a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:47.954779 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0e9cc-5ae6-4405-a65e-af579d14d2a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:47.956427 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0e9cc-5ae6-4405-a65e-af579d14d2a6 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:47.957330 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401800c-1303-4f98-b29e-93f2ec2adc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:47.958238 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401800c-1303-4f98-b29e-93f2ec2adc1b None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:47.958607 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401800c-1303-4f98-b29e-93f2ec2adc1b None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:47.958951 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401800c-1303-4f98-b29e-93f2ec2adc1b None admin] PATH_INFO: `/v3/services/image` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:47.959667 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401800c-1303-4f98-b29e-93f2ec2adc1b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:47.961156 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401800c-1303-4f98-b29e-93f2ec2adc1b None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:47.966315 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:47.974176 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-d401800c-1303-4f98-b29e-93f2ec2adc1b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 17:14:47.974176 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:47.974176 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 17:14:47.974176 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 17:14:47.974176 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 17:14:47.974176 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 17:14:47.974176 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 17:14:47.974176 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:14:47.974176 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 17:14:47.974176 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:47.974176 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:14:47.974176 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:47.974176 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:47.974176 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:47.974176 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:47.974176 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:47.974176 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:47.975485 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:47.975485 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:47.975485 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:47.975485 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:47.975485 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:47.975485 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:47.975485 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 17:14:47.975485 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 17:14:47.975485 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 17:14:47.975485 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 17:14:47.975485 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:47.975485 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:47.975485 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:47.975485 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:47.975485 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:47.975485 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:47.976521 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:47.976521 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:47.976521 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:47.976521 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:47.976521 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:47.976521 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:47.976521 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:47.976521 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:47.976521 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:47.976521 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:47.976521 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 17:14:47.976521 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:14:47.976521 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 17:14:47.976521 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:47.980125 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-26a0e9cc-5ae6-4405-a65e-af579d14d2a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:47.980125 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:47.980125 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:47.980125 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:47.980125 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:47.980125 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:47.980125 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:47.980125 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:47.980125 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:47.980125 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:47.980125 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:47.980125 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:47.980125 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:47.980125 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:47.980125 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:47.981112 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:47.981112 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:47.981112 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:47.981112 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:47.981112 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:47.981112 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:47.981112 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:47.981112 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:47.981112 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:47.981112 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:47.981112 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:47.981112 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:47.981112 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:47.981112 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:47.981112 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:47.981112 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:47.981112 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:47.982228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:47.982228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:47.982228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:47.982228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:47.982511 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 341/688] 10.222.0.15 () {56 vars in 1105 bytes} [Fri Jun 24 17:14:47 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:14:47.983883 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401800c-1303-4f98-b29e-93f2ec2adc1b None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:47.984320 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 348/689] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:14:47.990162 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0e9cc-5ae6-4405-a65e-af579d14d2a6 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:48.000688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:48.110919 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401800c-1303-4f98-b29e-93f2ec2adc1b None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:48.123847 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0e9cc-5ae6-4405-a65e-af579d14d2a6 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:48.148029 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07559a-c2b8-4f50-ac51-33b9580e8dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:48.148737 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07559a-c2b8-4f50-ac51-33b9580e8dcf None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:48.149138 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07559a-c2b8-4f50-ac51-33b9580e8dcf None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:48.149355 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07559a-c2b8-4f50-ac51-33b9580e8dcf None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:48.150071 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07559a-c2b8-4f50-ac51-33b9580e8dcf None admin] RBAC: Adding query filter params (name=image) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:48.150373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07559a-c2b8-4f50-ac51-33b9580e8dcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:48.151962 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07559a-c2b8-4f50-ac51-33b9580e8dcf None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:48.162753 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 342/690] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:48.163958 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07559a-c2b8-4f50-ac51-33b9580e8dcf None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:48.164608 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e9e74-5ae6-4cd3-bf60-c0279aea3e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:48.165300 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e9e74-5ae6-4cd3-bf60-c0279aea3e6b None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:48.165576 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e9e74-5ae6-4cd3-bf60-c0279aea3e6b None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:48.165846 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e9e74-5ae6-4cd3-bf60-c0279aea3e6b None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:48.166605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e9e74-5ae6-4cd3-bf60-c0279aea3e6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:48.166900 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e9e74-5ae6-4cd3-bf60-c0279aea3e6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:48.168304 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e9e74-5ae6-4cd3-bf60-c0279aea3e6b None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:48.188768 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 349/691] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:48.189976 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e9e74-5ae6-4cd3-bf60-c0279aea3e6b None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:48.261146 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:48.274134 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:48.299248 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07559a-c2b8-4f50-ac51-33b9580e8dcf None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:48.342314 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e9e74-5ae6-4cd3-bf60-c0279aea3e6b None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:48.349935 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e33941-273f-4978-a90e-5dc9b4d43b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:48.350906 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e33941-273f-4978-a90e-5dc9b4d43b70 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:48.351952 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e33941-273f-4978-a90e-5dc9b4d43b70 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:48.352424 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e33941-273f-4978-a90e-5dc9b4d43b70 None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:48.354583 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e33941-273f-4978-a90e-5dc9b4d43b70 None admin] RBAC: Adding query filter params (type=image) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:48.355104 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e33941-273f-4978-a90e-5dc9b4d43b70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:48.357436 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e33941-273f-4978-a90e-5dc9b4d43b70 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:48.365261 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 343/692] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:48.371579 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e33941-273f-4978-a90e-5dc9b4d43b70 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:48.384498 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c014b7-b88f-4887-8e5a-59fd314f938a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:48.386052 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c014b7-b88f-4887-8e5a-59fd314f938a None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:48.386557 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c014b7-b88f-4887-8e5a-59fd314f938a None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:48.387116 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c014b7-b88f-4887-8e5a-59fd314f938a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:48.396800 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c014b7-b88f-4887-8e5a-59fd314f938a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:48.399054 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c014b7-b88f-4887-8e5a-59fd314f938a None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:48.417410 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-95c014b7-b88f-4887-8e5a-59fd314f938a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:48.417410 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:48.417410 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:48.417410 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:48.417410 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:48.417410 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:48.417410 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:48.417410 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:48.417410 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:48.417410 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:48.417410 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:48.417410 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:48.417410 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 17:14:48.417410 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 17:14:48.417410 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 17:14:48.418428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 17:14:48.418428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:48.418428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:48.418428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:48.418428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:48.418428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:48.418428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:48.418428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:48.418428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:48.418428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:48.418428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:48.418428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:48.418428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:48.418428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:48.418428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:48.418428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:48.418428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:48.419659 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 17:14:48.419659 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 17:14:48.419659 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 17:14:48.419659 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 17:14:48.419659 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 17:14:48.419659 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 17:14:48.419659 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:48.419659 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:48.422859 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 350/693] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:48.423716 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c014b7-b88f-4887-8e5a-59fd314f938a None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:48.508418 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e33941-273f-4978-a90e-5dc9b4d43b70 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:48.534048 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c014b7-b88f-4887-8e5a-59fd314f938a None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:48.559547 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:48.562805 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb4b5e-8584-4b05-8a56-3ef5aa887942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:48.563925 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb4b5e-8584-4b05-8a56-3ef5aa887942 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:48.564372 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb4b5e-8584-4b05-8a56-3ef5aa887942 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:48.564802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb4b5e-8584-4b05-8a56-3ef5aa887942 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:48.566225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb4b5e-8584-4b05-8a56-3ef5aa887942 None admin] RBAC: Adding query filter params (interface=public, service_id=35c19d09567d444d9b653233fc16b544, region_id=RegionOne) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:48.567544 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb4b5e-8584-4b05-8a56-3ef5aa887942 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:48.569281 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb4b5e-8584-4b05-8a56-3ef5aa887942 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:48.577108 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:48.580196 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75a961-3dab-4b6e-aad9-566c5d39e00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:48.581158 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75a961-3dab-4b6e-aad9-566c5d39e00c None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:48.581524 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75a961-3dab-4b6e-aad9-566c5d39e00c None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:48.581901 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75a961-3dab-4b6e-aad9-566c5d39e00c None admin] PATH_INFO: `/v3/projects` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:48.582695 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 344/694] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Jun 24 17:14:48 2022] GET /identity/v3/endpoints?service_id=35c19d09567d444d9b653233fc16b544&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:48.587126 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75a961-3dab-4b6e-aad9-566c5d39e00c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:48.587668 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75a961-3dab-4b6e-aad9-566c5d39e00c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:48.589987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb4b5e-8584-4b05-8a56-3ef5aa887942 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:48.590445 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75a961-3dab-4b6e-aad9-566c5d39e00c None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:48.610913 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 351/695] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 24 17:14:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:48.612832 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75a961-3dab-4b6e-aad9-566c5d39e00c None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:48.717778 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb4b5e-8584-4b05-8a56-3ef5aa887942 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:48.737245 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75a961-3dab-4b6e-aad9-566c5d39e00c None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:48.756743 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c571c-0162-4723-95b0-319b1c5955d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:48.757838 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c571c-0162-4723-95b0-319b1c5955d2 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:48.758321 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c571c-0162-4723-95b0-319b1c5955d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:48.758842 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c571c-0162-4723-95b0-319b1c5955d2 None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:48.759747 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c571c-0162-4723-95b0-319b1c5955d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:48.761329 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c571c-0162-4723-95b0-319b1c5955d2 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:48.775331 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 345/696] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Jun 24 17:14:48 2022] GET /identity/v3/services => generated 1002 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 17:14:48.786535 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90a249-33ef-441e-9776-ee27cb42b62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:48.787907 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90a249-33ef-441e-9776-ee27cb42b62c None admin] REQUEST_METHOD: `PUT` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:48.788418 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90a249-33ef-441e-9776-ee27cb42b62c None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:48.788890 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90a249-33ef-441e-9776-ee27cb42b62c None admin] PATH_INFO: `/v3/projects/fb66039441c14b96a79a30de4a833fa2/users/9ff8200a750d49b1830c58f279e569c3/roles/ae295b7c396a4e559ecd6d574f097d4a` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:48.792123 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90a249-33ef-441e-9776-ee27cb42b62c None admin] RBAC: Authorizing `identity:create_grant(project_id=fb66039441c14b96a79a30de4a833fa2, user_id=9ff8200a750d49b1830c58f279e569c3, role_id=ae295b7c396a4e559ecd6d574f097d4a)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:48.793996 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90a249-33ef-441e-9776-ee27cb42b62c None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:48.813342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 352/697] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 24 17:14:48 2022] PUT /identity/v3/projects/fb66039441c14b96a79a30de4a833fa2/users/9ff8200a750d49b1830c58f279e569c3/roles/ae295b7c396a4e559ecd6d574f097d4a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 17:14:48.940258 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30f286-baa7-447f-9249-5cbe68345530 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:48.940651 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30f286-baa7-447f-9249-5cbe68345530 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:48.940822 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30f286-baa7-447f-9249-5cbe68345530 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:48.942782 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 346/698] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:48.948936 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc6e4b-1cce-413b-9aea-e776b7f4ba28 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:48.949599 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc6e4b-1cce-413b-9aea-e776b7f4ba28 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:48.950121 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc6e4b-1cce-413b-9aea-e776b7f4ba28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:48.970672 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-0afc6e4b-1cce-413b-9aea-e776b7f4ba28 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:48.972509 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-0afc6e4b-1cce-413b-9aea-e776b7f4ba28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:49.017647 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:49.073576 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 353/699] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:48 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:14:49.097818 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30f286-baa7-447f-9249-5cbe68345530 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:49.178700 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:49.222960 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30f286-baa7-447f-9249-5cbe68345530 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:49.260403 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aac18e-d6b3-46f2-acee-3cdd0fe904b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:49.261511 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aac18e-d6b3-46f2-acee-3cdd0fe904b0 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:49.261937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aac18e-d6b3-46f2-acee-3cdd0fe904b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:49.262363 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aac18e-d6b3-46f2-acee-3cdd0fe904b0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:49.263213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aac18e-d6b3-46f2-acee-3cdd0fe904b0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:49.264804 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aac18e-d6b3-46f2-acee-3cdd0fe904b0 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:49.278347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-b9aac18e-d6b3-46f2-acee-3cdd0fe904b0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 17:14:49.278347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:49.278347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 17:14:49.278347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 17:14:49.278347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 17:14:49.278347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 17:14:49.278347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 17:14:49.278347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:14:49.278347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 17:14:49.278347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:49.278347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:14:49.278347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:49.278347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:49.278347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:49.278347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:49.278347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:49.279580 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:49.279580 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:49.279580 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:49.279580 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:49.279580 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:49.279580 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:49.279580 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:49.279580 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 17:14:49.279580 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 17:14:49.279580 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 17:14:49.279580 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 17:14:49.279580 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:49.279580 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:49.279580 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:49.279580 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:49.279580 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:49.280661 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:49.280661 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:49.280661 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:49.280661 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:49.280661 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:49.280661 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:49.280661 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:49.280661 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:49.280661 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:49.280661 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:49.280661 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:49.280661 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 17:14:49.280661 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:14:49.280661 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 17:14:49.280661 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:49.283429 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 347/700] 10.222.0.15 () {56 vars in 1129 bytes} [Fri Jun 24 17:14:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:49.292220 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc6e4b-1cce-413b-9aea-e776b7f4ba28 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:49.388183 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12805536-cef2-4ef3-bf4d-3611a79e0d49 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:49.388819 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12805536-cef2-4ef3-bf4d-3611a79e0d49 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:49.389593 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12805536-cef2-4ef3-bf4d-3611a79e0d49 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:49.391777 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 348/701] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 17:14:49.397026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a8604-4e04-4159-85ac-676377302e88 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:49.397250 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc6e4b-1cce-413b-9aea-e776b7f4ba28 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:49.397413 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a8604-4e04-4159-85ac-676377302e88 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:49.397775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a8604-4e04-4159-85ac-676377302e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:49.415469 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-322a8604-4e04-4159-85ac-676377302e88 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:49.416733 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-322a8604-4e04-4159-85ac-676377302e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:49.434424 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf62daa-6729-423b-8d99-d2376717ea08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:49.435338 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf62daa-6729-423b-8d99-d2376717ea08 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:49.435693 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf62daa-6729-423b-8d99-d2376717ea08 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:49.436044 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf62daa-6729-423b-8d99-d2376717ea08 None admin] PATH_INFO: `/v3/services` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:49.436822 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf62daa-6729-423b-8d99-d2376717ea08 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:49.437193 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf62daa-6729-423b-8d99-d2376717ea08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:49.438766 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf62daa-6729-423b-8d99-d2376717ea08 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:49.444676 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 354/702] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Jun 24 17:14:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:49.449965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf62daa-6729-423b-8d99-d2376717ea08 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:49.487366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:49.506596 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 349/703] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:49 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 17:14:49.522763 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a8604-4e04-4159-85ac-676377302e88 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:49.559406 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf62daa-6729-423b-8d99-d2376717ea08 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:49.583624 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:49.599266 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdc4bb-95a5-4224-9fb4-0231e5b316da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:49.600295 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdc4bb-95a5-4224-9fb4-0231e5b316da None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:49.600799 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdc4bb-95a5-4224-9fb4-0231e5b316da None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:49.601279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdc4bb-95a5-4224-9fb4-0231e5b316da None admin] PATH_INFO: `/v3/services` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:49.602254 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bdc4bb-95a5-4224-9fb4-0231e5b316da None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:49.602778 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bdc4bb-95a5-4224-9fb4-0231e5b316da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:49.604451 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bdc4bb-95a5-4224-9fb4-0231e5b316da None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:49.611705 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 355/704] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Jun 24 17:14:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:49.622618 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdc4bb-95a5-4224-9fb4-0231e5b316da None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:49.628663 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a8604-4e04-4159-85ac-676377302e88 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:49.664089 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd7811-4023-4d12-b8af-f681b75b7931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:49.665140 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd7811-4023-4d12-b8af-f681b75b7931 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:49.665612 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd7811-4023-4d12-b8af-f681b75b7931 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:49.666018 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd7811-4023-4d12-b8af-f681b75b7931 None admin] PATH_INFO: `/v3/services/network` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:49.666832 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd7811-4023-4d12-b8af-f681b75b7931 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:49.668346 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd7811-4023-4d12-b8af-f681b75b7931 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:49.680658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-36bd7811-4023-4d12-b8af-f681b75b7931 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 17:14:49.680658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:49.680658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 17:14:49.680658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 17:14:49.680658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 17:14:49.680658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 17:14:49.680658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 17:14:49.680658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:14:49.680658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 17:14:49.680658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:49.680658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:14:49.680658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:49.680658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:49.680658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:49.680658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:49.680658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:49.680658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:49.681875 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:49.681875 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:49.681875 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:49.681875 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:49.681875 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:49.681875 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:49.681875 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 17:14:49.681875 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 17:14:49.681875 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 17:14:49.681875 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 17:14:49.681875 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:49.681875 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:49.681875 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:49.681875 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:49.681875 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:49.681875 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:49.682792 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:49.682792 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:49.682792 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:49.682792 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:49.682792 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:49.682792 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:49.682792 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:49.682792 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:49.682792 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:49.682792 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:49.682792 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 17:14:49.682792 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:14:49.682792 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 17:14:49.682792 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:49.689792 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 350/705] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:49 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:14:49.691261 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd7811-4023-4d12-b8af-f681b75b7931 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:49.728448 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:49.734223 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdc4bb-95a5-4224-9fb4-0231e5b316da None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:49.781744 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd22ef-e80e-46f6-b7af-8d17aafeb26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:49.782823 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd22ef-e80e-46f6-b7af-8d17aafeb26c None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:49.783121 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd22ef-e80e-46f6-b7af-8d17aafeb26c None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:49.783832 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd22ef-e80e-46f6-b7af-8d17aafeb26c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:49.784775 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd22ef-e80e-46f6-b7af-8d17aafeb26c None admin] RBAC: Adding query filter params (interface=public, service_id=8ef8ce43b21f4b9384b93b2c82f5aaae, region_id=RegionOne) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:49.785251 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd22ef-e80e-46f6-b7af-8d17aafeb26c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:49.787499 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd22ef-e80e-46f6-b7af-8d17aafeb26c None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:49.797295 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 356/706] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Jun 24 17:14:49 2022] GET /identity/v3/endpoints?service_id=8ef8ce43b21f4b9384b93b2c82f5aaae&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:49.804085 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd22ef-e80e-46f6-b7af-8d17aafeb26c None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:49.812232 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd7811-4023-4d12-b8af-f681b75b7931 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:49.835588 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:49.848122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa965b6-dbbf-4fdf-8365-9c5a7ce4a502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:49.849182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa965b6-dbbf-4fdf-8365-9c5a7ce4a502 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:49.849498 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa965b6-dbbf-4fdf-8365-9c5a7ce4a502 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:49.849768 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa965b6-dbbf-4fdf-8365-9c5a7ce4a502 None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:49.850472 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa965b6-dbbf-4fdf-8365-9c5a7ce4a502 None admin] RBAC: Adding query filter params (name=network) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:49.850811 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa965b6-dbbf-4fdf-8365-9c5a7ce4a502 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:49.852664 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa965b6-dbbf-4fdf-8365-9c5a7ce4a502 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:49.861993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 351/707] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 24 17:14:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:49.863332 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa965b6-dbbf-4fdf-8365-9c5a7ce4a502 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:49.926025 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd22ef-e80e-46f6-b7af-8d17aafeb26c None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:49.963796 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee657979-6a19-4a6a-bd48-179c6fa4166f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:49.964713 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee657979-6a19-4a6a-bd48-179c6fa4166f None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:49.965164 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee657979-6a19-4a6a-bd48-179c6fa4166f None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:49.965574 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee657979-6a19-4a6a-bd48-179c6fa4166f None admin] PATH_INFO: `/v3/services` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:49.966403 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee657979-6a19-4a6a-bd48-179c6fa4166f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:49.967982 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee657979-6a19-4a6a-bd48-179c6fa4166f None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:49.974718 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 357/708] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Jun 24 17:14:49 2022] GET /identity/v3/services => generated 1002 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 17:14:49.976765 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa965b6-dbbf-4fdf-8365-9c5a7ce4a502 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:50.036785 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40df68d-f969-4ad4-990d-6915b47a2d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:50.037718 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40df68d-f969-4ad4-990d-6915b47a2d13 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:50.038139 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40df68d-f969-4ad4-990d-6915b47a2d13 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:50.038615 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40df68d-f969-4ad4-990d-6915b47a2d13 None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:50.039556 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40df68d-f969-4ad4-990d-6915b47a2d13 None admin] RBAC: Adding query filter params (type=network) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:50.040006 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40df68d-f969-4ad4-990d-6915b47a2d13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:50.041604 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40df68d-f969-4ad4-990d-6915b47a2d13 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:50.048101 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 352/709] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 24 17:14:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:50.059733 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee657979-6a19-4a6a-bd48-179c6fa4166f None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:50.095026 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:50.177893 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee657979-6a19-4a6a-bd48-179c6fa4166f None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:50.215132 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937141e1-22e9-47b6-9ce7-f10385206a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:50.216084 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937141e1-22e9-47b6-9ce7-f10385206a6a None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:50.216363 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937141e1-22e9-47b6-9ce7-f10385206a6a None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:50.216630 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937141e1-22e9-47b6-9ce7-f10385206a6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:50.217519 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937141e1-22e9-47b6-9ce7-f10385206a6a None admin] RBAC: Adding query filter params (interface=public, service_id=222fc567cabb478b9b94ea77f29e45bb, region_id=RegionOne) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:50.217826 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937141e1-22e9-47b6-9ce7-f10385206a6a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:50.219232 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937141e1-22e9-47b6-9ce7-f10385206a6a None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:50.225306 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 358/710] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Jun 24 17:14:50 2022] GET /identity/v3/endpoints?service_id=222fc567cabb478b9b94ea77f29e45bb&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:50.231081 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40df68d-f969-4ad4-990d-6915b47a2d13 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:50.283219 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:50.335575 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40df68d-f969-4ad4-990d-6915b47a2d13 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:50.370730 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fcf0b-7201-4ed6-93c4-29b31032182d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:50.371398 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fcf0b-7201-4ed6-93c4-29b31032182d None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:50.371678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fcf0b-7201-4ed6-93c4-29b31032182d None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:50.372046 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fcf0b-7201-4ed6-93c4-29b31032182d None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:50.372914 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fcf0b-7201-4ed6-93c4-29b31032182d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:50.374297 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fcf0b-7201-4ed6-93c4-29b31032182d None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:50.380198 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 353/711] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Jun 24 17:14:50 2022] GET /identity/v3/services => generated 1002 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 17:14:51.195106 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ccad9-87df-4b57-8fd9-8f8b3c0953b4 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:51.195666 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ccad9-87df-4b57-8fd9-8f8b3c0953b4 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:51.195666 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ccad9-87df-4b57-8fd9-8f8b3c0953b4 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:51.197504 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 359/712] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:51.202777 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ea18f-4a09-4ca4-92bf-df07ac5dbcda None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:51.203132 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ea18f-4a09-4ca4-92bf-df07ac5dbcda None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:51.203474 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ea18f-4a09-4ca4-92bf-df07ac5dbcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:51.221884 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-1c0ea18f-4a09-4ca4-92bf-df07ac5dbcda None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:51.223222 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-1c0ea18f-4a09-4ca4-92bf-df07ac5dbcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:51.272094 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a29c99-9b48-42d6-a620-45bf4d76d868 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:51.272418 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a29c99-9b48-42d6-a620-45bf4d76d868 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:51.272631 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a29c99-9b48-42d6-a620-45bf4d76d868 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:51.274280 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 360/713] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:51.279485 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e25222-cd4c-498e-9cea-03f4523ad38c None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:51.279762 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e25222-cd4c-498e-9cea-03f4523ad38c None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:51.280086 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e25222-cd4c-498e-9cea-03f4523ad38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:51.298594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-e7e25222-cd4c-498e-9cea-03f4523ad38c None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:51.299953 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-e7e25222-cd4c-498e-9cea-03f4523ad38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:51.302343 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 354/714] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:51 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:14:51.320207 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ea18f-4a09-4ca4-92bf-df07ac5dbcda None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:51.367991 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:51.377455 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 361/715] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:51 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:14:51.402876 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e25222-cd4c-498e-9cea-03f4523ad38c None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:51.428655 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ea18f-4a09-4ca4-92bf-df07ac5dbcda None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:51.429246 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:51.465650 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827efe90-5aff-478d-bdd5-40bbbeb2e59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:51.466449 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827efe90-5aff-478d-bdd5-40bbbeb2e59e None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:51.466760 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827efe90-5aff-478d-bdd5-40bbbeb2e59e None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:51.467261 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827efe90-5aff-478d-bdd5-40bbbeb2e59e None admin] PATH_INFO: `/v3/services/image` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:51.467769 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827efe90-5aff-478d-bdd5-40bbbeb2e59e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:51.469237 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827efe90-5aff-478d-bdd5-40bbbeb2e59e None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:51.482026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-827efe90-5aff-478d-bdd5-40bbbeb2e59e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 17:14:51.482026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:51.482026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 17:14:51.482026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 17:14:51.482026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 17:14:51.482026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 17:14:51.482026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 17:14:51.482026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:14:51.482026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 17:14:51.482026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:51.482026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:14:51.482026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:51.482026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:51.482026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:51.482026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:51.482026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:51.482026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:51.483040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:51.483040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:51.483040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:51.483040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:51.483040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:51.483040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:51.483040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 17:14:51.483040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 17:14:51.483040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 17:14:51.483040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 17:14:51.483040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:51.483040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:51.483040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:51.483040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:51.483040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:51.483040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:51.483862 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:51.483862 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:51.483862 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:51.483862 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:51.483862 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:51.483862 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:51.483862 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:51.483862 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:51.483862 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:51.483862 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:51.483862 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 17:14:51.483862 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:14:51.483862 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 17:14:51.483862 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:51.488241 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 355/716] 10.222.0.15 () {56 vars in 1105 bytes} [Fri Jun 24 17:14:51 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:14:51.489411 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827efe90-5aff-478d-bdd5-40bbbeb2e59e None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:51.534344 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e25222-cd4c-498e-9cea-03f4523ad38c None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:51.581277 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef98365-310e-4e55-9544-30435d992a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:51.582671 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef98365-310e-4e55-9544-30435d992a7d None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:51.583124 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef98365-310e-4e55-9544-30435d992a7d None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:51.594790 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef98365-310e-4e55-9544-30435d992a7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:51.609362 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef98365-310e-4e55-9544-30435d992a7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:14:51.618996 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827efe90-5aff-478d-bdd5-40bbbeb2e59e None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:51.620610 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-8ef98365-310e-4e55-9544-30435d992a7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:14:51.620610 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:51.620610 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:51.620610 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:51.620610 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:51.620610 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:51.620610 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:51.620610 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:51.620610 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:51.620610 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:51.620610 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:51.620610 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:51.620610 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:14:51.620610 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:14:51.620610 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:14:51.620610 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:14:51.621521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:14:51.621521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:14:51.621521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:14:51.621521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:14:51.621521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:51.621521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:51.621521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:51.621521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:51.621521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:51.621521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:51.621521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:51.621521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:51.621521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:51.621521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:51.621521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:51.621521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:51.622351 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:51.622351 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:51.622351 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:51.622351 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:51.622351 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:14:51.622351 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:14:51.622351 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:14:51.622351 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:14:51.622351 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:14:51.622351 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:14:51.622351 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:14:51.622351 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:51.626650 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 362/717] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 24 17:14:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:14:51.631272 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef98365-310e-4e55-9544-30435d992a7d None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:51.639280 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:51.682910 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60244f-ab52-4466-b693-3a8d9d6a203a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:51.686729 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60244f-ab52-4466-b693-3a8d9d6a203a None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:51.687171 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60244f-ab52-4466-b693-3a8d9d6a203a None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:51.687467 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60244f-ab52-4466-b693-3a8d9d6a203a None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:51.694303 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60244f-ab52-4466-b693-3a8d9d6a203a None admin] RBAC: Adding query filter params (name=image) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:51.694303 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60244f-ab52-4466-b693-3a8d9d6a203a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:51.697477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60244f-ab52-4466-b693-3a8d9d6a203a None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:51.717196 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 356/718] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:51.718515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60244f-ab52-4466-b693-3a8d9d6a203a None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:51.761193 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:51.788230 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef98365-310e-4e55-9544-30435d992a7d None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:51.824435 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4670d-3b08-4af2-a034-939a7926a711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:51.825496 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4670d-3b08-4af2-a034-939a7926a711 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:51.826074 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4670d-3b08-4af2-a034-939a7926a711 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:51.826541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4670d-3b08-4af2-a034-939a7926a711 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:51.827600 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4670d-3b08-4af2-a034-939a7926a711 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:51.828097 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4670d-3b08-4af2-a034-939a7926a711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:51.829691 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4670d-3b08-4af2-a034-939a7926a711 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:51.839228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 363/719] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:14:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:51.844562 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4670d-3b08-4af2-a034-939a7926a711 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:51.845881 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60244f-ab52-4466-b693-3a8d9d6a203a None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:51.888796 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9b7d3-5ff6-45a7-80b5-6f430ae2e82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:51.889996 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9b7d3-5ff6-45a7-80b5-6f430ae2e82e None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:51.890668 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9b7d3-5ff6-45a7-80b5-6f430ae2e82e None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:51.891141 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9b7d3-5ff6-45a7-80b5-6f430ae2e82e None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:51.892790 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9b7d3-5ff6-45a7-80b5-6f430ae2e82e None admin] RBAC: Adding query filter params (type=image) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:51.893314 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9b7d3-5ff6-45a7-80b5-6f430ae2e82e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:51.895205 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9b7d3-5ff6-45a7-80b5-6f430ae2e82e None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:51.901935 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 357/720] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:51.907994 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9b7d3-5ff6-45a7-80b5-6f430ae2e82e None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:51.962602 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:51.984631 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4670d-3b08-4af2-a034-939a7926a711 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:52.035900 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a4636-e61c-486b-9115-5eb118e3a0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:52.037737 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a4636-e61c-486b-9115-5eb118e3a0d9 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:52.038211 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a4636-e61c-486b-9115-5eb118e3a0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:52.038753 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a4636-e61c-486b-9115-5eb118e3a0d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:52.047630 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9b7d3-5ff6-45a7-80b5-6f430ae2e82e None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:52.051004 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a4636-e61c-486b-9115-5eb118e3a0d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:52.052686 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a4636-e61c-486b-9115-5eb118e3a0d9 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:52.054991 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:52.073943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-3a1a4636-e61c-486b-9115-5eb118e3a0d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:52.073943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:52.073943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:52.073943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:52.073943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:52.073943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:52.073943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:52.073943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:52.073943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:52.073943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:52.073943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:52.073943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:52.073943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:52.073943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:52.073943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:52.075134 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:52.075134 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:52.075134 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:52.075134 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:52.075134 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:52.075134 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:52.075134 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:52.075134 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:52.075134 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:52.075134 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:52.075134 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:52.075134 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:52.075134 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:52.075134 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:52.075134 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:52.075134 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:52.075134 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:52.076007 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:52.076007 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:52.076007 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:52.076007 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:52.078304 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 364/721] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:14:52.084709 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a4636-e61c-486b-9115-5eb118e3a0d9 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:52.093575 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfce8e-6623-41e8-8d67-742c07a01972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:52.094230 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfce8e-6623-41e8-8d67-742c07a01972 None admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:52.094509 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfce8e-6623-41e8-8d67-742c07a01972 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:52.094823 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfce8e-6623-41e8-8d67-742c07a01972 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:52.095562 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcfce8e-6623-41e8-8d67-742c07a01972 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:52.096940 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcfce8e-6623-41e8-8d67-742c07a01972 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:52.130600 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 358/722] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Jun 24 17:14:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:14:52.217293 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a4636-e61c-486b-9115-5eb118e3a0d9 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:52.264519 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94402294-7c69-4b4a-b642-463c36a5a2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:52.265203 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94402294-7c69-4b4a-b642-463c36a5a2d6 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:52.265482 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94402294-7c69-4b4a-b642-463c36a5a2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:52.265753 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94402294-7c69-4b4a-b642-463c36a5a2d6 None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:52.266537 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94402294-7c69-4b4a-b642-463c36a5a2d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:52.266921 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94402294-7c69-4b4a-b642-463c36a5a2d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:52.268456 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94402294-7c69-4b4a-b642-463c36a5a2d6 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:52.283061 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 365/723] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:52.291912 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfce8e-6623-41e8-8d67-742c07a01972 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:52.394290 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:52.403689 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfce8e-6623-41e8-8d67-742c07a01972 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:52.416162 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17736a-2914-4213-bacb-86a651e2daa7 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:52.416489 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17736a-2914-4213-bacb-86a651e2daa7 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:52.416910 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17736a-2914-4213-bacb-86a651e2daa7 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:52.418297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 366/724] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:52.423208 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f9a3d-efe1-4c42-a366-0de4fb0b2725 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:52.423501 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f9a3d-efe1-4c42-a366-0de4fb0b2725 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:52.423989 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f9a3d-efe1-4c42-a366-0de4fb0b2725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:52.441583 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-fe8f9a3d-efe1-4c42-a366-0de4fb0b2725 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:52.442833 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-fe8f9a3d-efe1-4c42-a366-0de4fb0b2725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:52.443342 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaea2fc-cd76-426a-88c6-49d0d793b2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:52.444203 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaea2fc-cd76-426a-88c6-49d0d793b2a1 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:52.444482 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaea2fc-cd76-426a-88c6-49d0d793b2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:52.444751 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaea2fc-cd76-426a-88c6-49d0d793b2a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:52.455373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaea2fc-cd76-426a-88c6-49d0d793b2a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:52.457242 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaea2fc-cd76-426a-88c6-49d0d793b2a1 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:52.473574 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-fbaea2fc-cd76-426a-88c6-49d0d793b2a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 17:14:52.473574 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:52.473574 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:52.473574 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:52.473574 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:52.473574 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:52.473574 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:52.473574 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:52.473574 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:52.473574 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:52.473574 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:52.473574 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:52.473574 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 17:14:52.473574 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 17:14:52.473574 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 17:14:52.473574 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 17:14:52.475410 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:52.475410 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:52.475410 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 17:14:52.475410 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:52.475410 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 17:14:52.475410 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:14:52.475410 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:52.475410 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:52.475410 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:52.475410 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:52.475410 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:52.475410 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:52.475410 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:52.475410 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:52.475410 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:52.475410 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:52.475410 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:52.475410 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:52.477263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:52.477263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:52.477263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 17:14:52.477263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 17:14:52.477263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 17:14:52.477263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 17:14:52.477263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 17:14:52.477263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 17:14:52.477263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 17:14:52.477263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:52.477263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 359/725] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Jun 24 17:14:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:52.485776 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaea2fc-cd76-426a-88c6-49d0d793b2a1 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:52.513526 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:52.528216 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 367/726] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:52 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 17:14:52.552929 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f9a3d-efe1-4c42-a366-0de4fb0b2725 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:52.605308 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaea2fc-cd76-426a-88c6-49d0d793b2a1 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:52.652382 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f9a3d-efe1-4c42-a366-0de4fb0b2725 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:52.654595 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94badefd-fc90-436e-88c2-ce9decffc93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:52.656213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94badefd-fc90-436e-88c2-ce9decffc93d None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:52.656498 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94badefd-fc90-436e-88c2-ce9decffc93d None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:52.656770 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94badefd-fc90-436e-88c2-ce9decffc93d None admin] PATH_INFO: `/v3/users` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:52.657664 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94badefd-fc90-436e-88c2-ce9decffc93d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:52.657969 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94badefd-fc90-436e-88c2-ce9decffc93d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:52.659513 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94badefd-fc90-436e-88c2-ce9decffc93d None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:52.686669 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 360/727] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Jun 24 17:14:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:52.688299 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94badefd-fc90-436e-88c2-ce9decffc93d None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:52.696351 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c3b0e-791d-4dc2-b056-154cb6767a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:52.697175 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c3b0e-791d-4dc2-b056-154cb6767a2f None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:52.697452 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c3b0e-791d-4dc2-b056-154cb6767a2f None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:52.697720 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c3b0e-791d-4dc2-b056-154cb6767a2f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:52.698374 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c3b0e-791d-4dc2-b056-154cb6767a2f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:52.699875 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c3b0e-791d-4dc2-b056-154cb6767a2f None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:52.703480 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:52.713411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-4d5c3b0e-791d-4dc2-b056-154cb6767a2f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 17:14:52.713411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:52.713411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 17:14:52.713411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 17:14:52.713411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 17:14:52.713411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 17:14:52.713411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 17:14:52.713411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:14:52.713411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 17:14:52.713411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:52.713411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:14:52.713411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:52.713411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:52.713411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:52.713411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:52.713411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:52.714657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:52.714657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:52.714657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:52.714657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:52.714657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:52.714657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:52.714657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:52.714657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 17:14:52.714657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 17:14:52.714657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 17:14:52.714657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 17:14:52.714657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:52.714657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:52.714657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:52.714657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:52.714657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:52.715583 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:52.715583 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:52.715583 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:52.715583 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:52.715583 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:52.715583 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:52.715583 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:52.715583 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:52.715583 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:52.715583 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:52.715583 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:52.715583 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 17:14:52.715583 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:14:52.715583 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 17:14:52.715583 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:52.716370 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 368/728] 10.222.0.15 () {56 vars in 1129 bytes} [Fri Jun 24 17:14:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:14:52.721770 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c3b0e-791d-4dc2-b056-154cb6767a2f None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:52.772833 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:52.806251 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94badefd-fc90-436e-88c2-ce9decffc93d None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:52.831343 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c3b0e-791d-4dc2-b056-154cb6767a2f None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:52.841600 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bc60c-69bd-40a4-8c8a-be1bceba84f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:52.842248 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bc60c-69bd-40a4-8c8a-be1bceba84f5 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:52.842524 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bc60c-69bd-40a4-8c8a-be1bceba84f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:52.842821 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bc60c-69bd-40a4-8c8a-be1bceba84f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:52.867517 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c25c9-84ea-4f4f-b518-bbe65ca84c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:52.868466 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c25c9-84ea-4f4f-b518-bbe65ca84c29 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:52.868943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c25c9-84ea-4f4f-b518-bbe65ca84c29 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:52.869354 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c25c9-84ea-4f4f-b518-bbe65ca84c29 None admin] PATH_INFO: `/v3/services` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:52.870243 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c25c9-84ea-4f4f-b518-bbe65ca84c29 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:52.870717 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c25c9-84ea-4f4f-b518-bbe65ca84c29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:52.872288 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c25c9-84ea-4f4f-b518-bbe65ca84c29 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:52.877277 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 369/729] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Jun 24 17:14:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:52.878877 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3d535-5439-46c2-b046-315d70f99c9f None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:52.879340 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3d535-5439-46c2-b046-315d70f99c9f None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:52.879785 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3d535-5439-46c2-b046-315d70f99c9f None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:52.881422 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 370/730] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:52.882917 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3d535-5439-46c2-b046-315d70f99c9f None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:52.917139 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00bc60c-69bd-40a4-8c8a-be1bceba84f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:52.918855 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00bc60c-69bd-40a4-8c8a-be1bceba84f5 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:52.931478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:52.990757 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3d535-5439-46c2-b046-315d70f99c9f None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:53.000925 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:53.037077 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 361/731] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:14:52 2022] GET /identity/v3/auth/tokens => generated 1247 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 17:14:53.038614 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27460e5-18b7-4ada-abd5-5557c4a91a26 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:53.039051 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27460e5-18b7-4ada-abd5-5557c4a91a26 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:53.039326 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27460e5-18b7-4ada-abd5-5557c4a91a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:53.044474 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad086cb6-8d1b-4f96-927d-0b65dfec11a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:53.045145 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad086cb6-8d1b-4f96-927d-0b65dfec11a5 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:53.045537 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad086cb6-8d1b-4f96-927d-0b65dfec11a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:53.045806 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad086cb6-8d1b-4f96-927d-0b65dfec11a5 None admin] PATH_INFO: `/v3/services` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:53.046509 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad086cb6-8d1b-4f96-927d-0b65dfec11a5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:53.046853 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad086cb6-8d1b-4f96-927d-0b65dfec11a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:53.048262 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad086cb6-8d1b-4f96-927d-0b65dfec11a5 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:53.054201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 371/732] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Jun 24 17:14:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:53.054854 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad086cb6-8d1b-4f96-927d-0b65dfec11a5 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:53.059769 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-d27460e5-18b7-4ada-abd5-5557c4a91a26 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:53.060961 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-d27460e5-18b7-4ada-abd5-5557c4a91a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:53.131513 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 362/733] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:53 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:14:53.132679 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27460e5-18b7-4ada-abd5-5557c4a91a26 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:53.169377 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad086cb6-8d1b-4f96-927d-0b65dfec11a5 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:53.176449 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:53.212112 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bc9ca-be57-4ed8-b17a-c61e6ccec1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:53.213061 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bc9ca-be57-4ed8-b17a-c61e6ccec1cb None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:53.213180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bc9ca-be57-4ed8-b17a-c61e6ccec1cb None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:53.213417 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bc9ca-be57-4ed8-b17a-c61e6ccec1cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:53.223996 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bc9ca-be57-4ed8-b17a-c61e6ccec1cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:53.225441 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bc9ca-be57-4ed8-b17a-c61e6ccec1cb None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:53.235373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27460e5-18b7-4ada-abd5-5557c4a91a26 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:53.243337 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-924bc9ca-be57-4ed8-b17a-c61e6ccec1cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:53.243337 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:53.243337 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:53.243337 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:53.243337 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:53.243337 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:53.243337 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:53.243337 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:53.243337 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:53.243337 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:53.243337 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:53.243337 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:53.243337 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:53.243337 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:53.243337 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:53.244377 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:53.244377 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:53.244377 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:53.244377 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:53.244377 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:53.244377 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:53.244377 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:53.244377 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:53.244377 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:53.244377 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:53.244377 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:53.244377 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:53.244377 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:53.244377 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:53.244377 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:53.244377 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:53.244377 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:53.245411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:53.245411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:53.245411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:53.245411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:53.245411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 372/734] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:53.245411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bc9ca-be57-4ed8-b17a-c61e6ccec1cb None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:53.272085 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:53.276727 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca26cea-91bb-47e8-acd5-3779c02c54c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:53.277454 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca26cea-91bb-47e8-acd5-3779c02c54c3 None admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:53.277661 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca26cea-91bb-47e8-acd5-3779c02c54c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:53.277932 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca26cea-91bb-47e8-acd5-3779c02c54c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:53.278708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca26cea-91bb-47e8-acd5-3779c02c54c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:53.280096 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca26cea-91bb-47e8-acd5-3779c02c54c3 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:53.300189 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 363/735] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Jun 24 17:14:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:14:53.301054 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca26cea-91bb-47e8-acd5-3779c02c54c3 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:53.384030 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bc9ca-be57-4ed8-b17a-c61e6ccec1cb None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:53.431750 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:53.446824 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca26cea-91bb-47e8-acd5-3779c02c54c3 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:53.447685 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68d3bd-9501-4577-9e58-7ca5e324d373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:53.448657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68d3bd-9501-4577-9e58-7ca5e324d373 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:53.449368 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68d3bd-9501-4577-9e58-7ca5e324d373 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:53.449840 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68d3bd-9501-4577-9e58-7ca5e324d373 None admin] PATH_INFO: `/v3/services/network` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:53.451263 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68d3bd-9501-4577-9e58-7ca5e324d373 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:53.452674 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68d3bd-9501-4577-9e58-7ca5e324d373 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:53.470357 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-2f68d3bd-9501-4577-9e58-7ca5e324d373 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 17:14:53.470357 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:53.470357 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 17:14:53.470357 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 17:14:53.470357 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 17:14:53.470357 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 17:14:53.470357 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 17:14:53.470357 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:14:53.470357 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 17:14:53.470357 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:53.470357 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:14:53.470357 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:53.470357 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:53.470357 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:53.470357 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:53.470357 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:53.470357 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:53.471488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:53.471488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:53.471488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:53.471488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:53.471488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:53.471488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:53.471488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 17:14:53.471488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 17:14:53.471488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 17:14:53.471488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 17:14:53.471488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:53.471488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:53.471488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:53.471488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:53.471488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:53.471488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:53.472415 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:53.472415 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:53.472415 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:53.472415 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:53.472415 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:53.472415 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:53.472415 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:53.472415 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:53.472415 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:53.472415 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:53.472415 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 17:14:53.472415 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:14:53.472415 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 17:14:53.472415 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:53.476583 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 373/736] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:53 2022] GET /identity/v3/services/network => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:53.482776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68d3bd-9501-4577-9e58-7ca5e324d373 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:53.491310 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bc639-9156-4ffc-8c58-be7c090a2d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:53.492150 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bc639-9156-4ffc-8c58-be7c090a2d14 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:53.492535 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bc639-9156-4ffc-8c58-be7c090a2d14 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:53.492899 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bc639-9156-4ffc-8c58-be7c090a2d14 None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:53.493743 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8bc639-9156-4ffc-8c58-be7c090a2d14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:53.494147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8bc639-9156-4ffc-8c58-be7c090a2d14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:53.496532 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8bc639-9156-4ffc-8c58-be7c090a2d14 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:53.522664 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 364/737] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:53.525645 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bc639-9156-4ffc-8c58-be7c090a2d14 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:53.603956 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:53.626318 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68d3bd-9501-4577-9e58-7ca5e324d373 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:53.647750 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bc639-9156-4ffc-8c58-be7c090a2d14 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:53.672993 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7ec65-777b-440e-8b9d-3289eee56c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:53.673909 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7ec65-777b-440e-8b9d-3289eee56c16 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:53.674192 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7ec65-777b-440e-8b9d-3289eee56c16 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:53.674911 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7ec65-777b-440e-8b9d-3289eee56c16 None admin] PATH_INFO: `/v3/services` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:53.676058 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7ec65-777b-440e-8b9d-3289eee56c16 None admin] RBAC: Adding query filter params (name=network) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:53.676367 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7ec65-777b-440e-8b9d-3289eee56c16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:53.678598 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7ec65-777b-440e-8b9d-3289eee56c16 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:53.684722 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 374/738] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 24 17:14:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:53.685780 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d7c97-edf4-45ad-836f-2443b96bbe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:53.686598 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d7c97-edf4-45ad-836f-2443b96bbe29 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:53.686898 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d7c97-edf4-45ad-836f-2443b96bbe29 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:53.687167 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d7c97-edf4-45ad-836f-2443b96bbe29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:53.690476 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7ec65-777b-440e-8b9d-3289eee56c16 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:53.695413 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d7c97-edf4-45ad-836f-2443b96bbe29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:53.696562 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d7c97-edf4-45ad-836f-2443b96bbe29 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:53.711494 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-a54d7c97-edf4-45ad-836f-2443b96bbe29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:53.711494 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:53.711494 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:53.711494 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:53.711494 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:53.711494 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:53.711494 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:53.711494 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:53.711494 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:53.711494 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:53.711494 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:53.711494 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:53.711494 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 17:14:53.711494 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 17:14:53.711494 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 17:14:53.712399 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 17:14:53.712399 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:53.712399 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:53.712399 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:53.712399 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:53.712399 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:53.712399 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:53.712399 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:53.712399 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:53.712399 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:53.712399 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:53.712399 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:53.712399 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:53.712399 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:53.712399 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:53.712399 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:53.712399 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:53.713725 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 17:14:53.713725 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 17:14:53.713725 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 17:14:53.713725 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 17:14:53.713725 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 17:14:53.713725 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 17:14:53.713725 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:14:53.713725 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:53.713725 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 365/739] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:14:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:53.718687 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d7c97-edf4-45ad-836f-2443b96bbe29 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:53.736069 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:53.826327 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7ec65-777b-440e-8b9d-3289eee56c16 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:53.831984 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d7c97-edf4-45ad-836f-2443b96bbe29 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:53.871986 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2285fd5-e174-4471-a17f-c9e14863000a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:53.872847 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2285fd5-e174-4471-a17f-c9e14863000a None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:53.873232 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2285fd5-e174-4471-a17f-c9e14863000a None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:53.873627 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2285fd5-e174-4471-a17f-c9e14863000a None admin] PATH_INFO: `/v3/projects` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:53.873841 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40482e09-c9c4-4bf9-be45-563362749c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:53.874614 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2285fd5-e174-4471-a17f-c9e14863000a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:53.874846 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40482e09-c9c4-4bf9-be45-563362749c7c None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:53.875102 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2285fd5-e174-4471-a17f-c9e14863000a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:53.875406 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40482e09-c9c4-4bf9-be45-563362749c7c None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:53.875816 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40482e09-c9c4-4bf9-be45-563362749c7c None admin] PATH_INFO: `/v3/services` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:53.876671 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40482e09-c9c4-4bf9-be45-563362749c7c None admin] RBAC: Adding query filter params (type=network) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:53.876893 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2285fd5-e174-4471-a17f-c9e14863000a None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:53.877261 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40482e09-c9c4-4bf9-be45-563362749c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:53.879342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40482e09-c9c4-4bf9-be45-563362749c7c None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:53.885407 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 375/740] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 24 17:14:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:53.891413 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40482e09-c9c4-4bf9-be45-563362749c7c None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:53.894607 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 366/741] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 24 17:14:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:53.900612 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2285fd5-e174-4471-a17f-c9e14863000a None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:53.909187 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:53.982482 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:54.000192 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40482e09-c9c4-4bf9-be45-563362749c7c None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:54.022496 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2285fd5-e174-4471-a17f-c9e14863000a None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:54.043402 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2677a7-7f24-43c6-b97c-fb0da1cea08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:54.044314 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2677a7-7f24-43c6-b97c-fb0da1cea08c None admin] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:54.044781 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2677a7-7f24-43c6-b97c-fb0da1cea08c None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:54.045260 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2677a7-7f24-43c6-b97c-fb0da1cea08c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:54.046197 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2677a7-7f24-43c6-b97c-fb0da1cea08c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:54.047806 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2677a7-7f24-43c6-b97c-fb0da1cea08c None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:54.064625 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48b788-06dc-47d2-9b88-53cfa3a27176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:54.065340 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48b788-06dc-47d2-9b88-53cfa3a27176 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:54.065681 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48b788-06dc-47d2-9b88-53cfa3a27176 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:54.066006 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48b788-06dc-47d2-9b88-53cfa3a27176 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:54.067270 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48b788-06dc-47d2-9b88-53cfa3a27176 None admin] RBAC: Adding query filter params (role.id=ae295b7c396a4e559ecd6d574f097d4a, scope.project.id=fb66039441c14b96a79a30de4a833fa2, user.id=9ff8200a750d49b1830c58f279e569c3) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:54.067612 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48b788-06dc-47d2-9b88-53cfa3a27176 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:54.069118 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48b788-06dc-47d2-9b88-53cfa3a27176 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:54.074166 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 376/742] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Jun 24 17:14:53 2022] POST /identity/v3/endpoints => generated 327 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:14:54.077073 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 367/743] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:14:53 2022] GET /identity/v3/role_assignments?user.id=9ff8200a750d49b1830c58f279e569c3&scope.project.id=fb66039441c14b96a79a30de4a833fa2&role.id=ae295b7c396a4e559ecd6d574f097d4a => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:54.584351 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290522f6-0095-409b-8d50-8a2a821ee4b4 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:54.584895 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290522f6-0095-409b-8d50-8a2a821ee4b4 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:54.584895 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290522f6-0095-409b-8d50-8a2a821ee4b4 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:54.586465 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 377/744] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:54.592110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abba3a9-6005-41ac-bb1d-416c5de27ae5 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:54.592607 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abba3a9-6005-41ac-bb1d-416c5de27ae5 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:54.592713 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abba3a9-6005-41ac-bb1d-416c5de27ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:54.611982 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-1abba3a9-6005-41ac-bb1d-416c5de27ae5 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:54.613267 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-1abba3a9-6005-41ac-bb1d-416c5de27ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:54.694624 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 368/745] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:54 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:14:54.715163 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290522f6-0095-409b-8d50-8a2a821ee4b4 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:54.789397 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:54.825748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290522f6-0095-409b-8d50-8a2a821ee4b4 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:54.862671 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364216fe-5447-4019-838f-7801082f8553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:54.863437 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364216fe-5447-4019-838f-7801082f8553 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:54.863714 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364216fe-5447-4019-838f-7801082f8553 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:54.864029 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364216fe-5447-4019-838f-7801082f8553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:54.931128 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364216fe-5447-4019-838f-7801082f8553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:54.932593 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364216fe-5447-4019-838f-7801082f8553 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:54.996091 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:55.038637 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 378/746] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:14:54 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 17:14:55.041802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abba3a9-6005-41ac-bb1d-416c5de27ae5 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:55.111621 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:55.153262 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abba3a9-6005-41ac-bb1d-416c5de27ae5 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:55.189000 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2f3b5-274f-496e-996f-5891a57a14c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:55.189791 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2f3b5-274f-496e-996f-5891a57a14c2 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:55.190068 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2f3b5-274f-496e-996f-5891a57a14c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:55.190411 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2f3b5-274f-496e-996f-5891a57a14c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:55.200955 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2f3b5-274f-496e-996f-5891a57a14c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:55.202436 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2f3b5-274f-496e-996f-5891a57a14c2 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:55.220448 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-6dc2f3b5-274f-496e-996f-5891a57a14c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:55.220448 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:55.220448 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:55.220448 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:55.220448 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:55.220448 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:55.220448 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:55.220448 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:55.220448 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:55.220448 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:55.220448 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:55.220448 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:55.220448 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:14:55.220448 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:14:55.220448 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:14:55.221377 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:14:55.221377 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:55.221377 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:55.221377 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:55.221377 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:55.221377 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:55.221377 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:55.221377 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:55.221377 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:55.221377 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:55.221377 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:55.221377 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:55.221377 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:55.221377 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:55.221377 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:55.221377 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:55.221377 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:55.228003 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:14:55.228003 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:14:55.228003 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:14:55.228003 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:55.228003 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 369/747] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:55.228649 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364216fe-5447-4019-838f-7801082f8553 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:55.332333 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364216fe-5447-4019-838f-7801082f8553 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:55.366784 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87eeba-417d-49eb-8adc-590ca77d2cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:55.367440 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87eeba-417d-49eb-8adc-590ca77d2cf5 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:55.367717 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87eeba-417d-49eb-8adc-590ca77d2cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:55.367986 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87eeba-417d-49eb-8adc-590ca77d2cf5 None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:55.368705 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87eeba-417d-49eb-8adc-590ca77d2cf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:55.369007 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87eeba-417d-49eb-8adc-590ca77d2cf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:55.370393 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87eeba-417d-49eb-8adc-590ca77d2cf5 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:55.382371 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 379/748] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:55.784102 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7d7c3-e30d-4f32-8eb0-78877de2e7ce None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:55.784731 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7d7c3-e30d-4f32-8eb0-78877de2e7ce None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:55.784731 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7d7c3-e30d-4f32-8eb0-78877de2e7ce None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:55.786127 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 370/749] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:55.791610 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2124622-d554-4d9f-8788-ff86277121ab None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:55.792027 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2124622-d554-4d9f-8788-ff86277121ab None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:55.792237 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2124622-d554-4d9f-8788-ff86277121ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:55.810404 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-f2124622-d554-4d9f-8788-ff86277121ab None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:55.811620 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-f2124622-d554-4d9f-8788-ff86277121ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:55.836424 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:55.882092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 380/750] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:55 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:14:55.905835 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7d7c3-e30d-4f32-8eb0-78877de2e7ce None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:56.013051 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7d7c3-e30d-4f32-8eb0-78877de2e7ce None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:56.033566 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:56.055191 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea96ec-e8eb-481a-b24c-83edd421a085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:56.055931 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea96ec-e8eb-481a-b24c-83edd421a085 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:56.056249 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea96ec-e8eb-481a-b24c-83edd421a085 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:56.056511 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea96ec-e8eb-481a-b24c-83edd421a085 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:56.057159 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea96ec-e8eb-481a-b24c-83edd421a085 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:56.058515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea96ec-e8eb-481a-b24c-83edd421a085 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:56.070428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-d3ea96ec-e8eb-481a-b24c-83edd421a085 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 17:14:56.070428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:56.070428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 17:14:56.070428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 17:14:56.070428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 17:14:56.070428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 17:14:56.070428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 17:14:56.070428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:14:56.070428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 17:14:56.070428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:56.070428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:14:56.070428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:56.070428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:56.070428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:56.070428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:56.070428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:56.070428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:56.071601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:56.071601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:56.071601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:56.071601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:56.071601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:56.071601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:56.071601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 17:14:56.071601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 17:14:56.071601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 17:14:56.071601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 17:14:56.071601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:56.071601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:56.071601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:56.071601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:56.071601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:56.071601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:56.072465 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:56.072465 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:56.072465 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:56.072465 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:56.072465 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:56.072465 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:56.072465 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:56.072465 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:56.072465 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:56.072465 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:56.072465 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 17:14:56.072465 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:14:56.072465 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 17:14:56.072465 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:14:56.072465 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 371/751] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 24 17:14:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:56.077593 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2124622-d554-4d9f-8788-ff86277121ab None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:56.182807 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2124622-d554-4d9f-8788-ff86277121ab None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:56.219889 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afdfe6-3a5b-442f-be4a-6f39afe441d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:56.220575 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afdfe6-3a5b-442f-be4a-6f39afe441d2 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:56.220856 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afdfe6-3a5b-442f-be4a-6f39afe441d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:56.221122 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afdfe6-3a5b-442f-be4a-6f39afe441d2 None admin] PATH_INFO: `/v3/services` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:56.221867 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afdfe6-3a5b-442f-be4a-6f39afe441d2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:56.222264 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afdfe6-3a5b-442f-be4a-6f39afe441d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:56.224016 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afdfe6-3a5b-442f-be4a-6f39afe441d2 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:56.233935 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 381/752] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 24 17:14:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:56.235263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea96ec-e8eb-481a-b24c-83edd421a085 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:56.341579 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea96ec-e8eb-481a-b24c-83edd421a085 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:56.376037 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0618ba-322f-454e-a0d1-0af0d729c402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:56.376695 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0618ba-322f-454e-a0d1-0af0d729c402 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:56.376970 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0618ba-322f-454e-a0d1-0af0d729c402 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:56.377240 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0618ba-322f-454e-a0d1-0af0d729c402 None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:56.377941 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0618ba-322f-454e-a0d1-0af0d729c402 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:56.378311 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0618ba-322f-454e-a0d1-0af0d729c402 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:56.379734 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0618ba-322f-454e-a0d1-0af0d729c402 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:56.384569 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 372/753] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 24 17:14:56 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:14:56.438692 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5970a-2c3d-4bf0-b32b-afeceac1788a None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:56.439039 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5970a-2c3d-4bf0-b32b-afeceac1788a None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:56.439397 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5970a-2c3d-4bf0-b32b-afeceac1788a None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:56.440890 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 382/754] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:56.447212 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92824dbb-cb68-4537-b547-7c038c77eed5 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:56.447495 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92824dbb-cb68-4537-b547-7c038c77eed5 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:56.447772 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92824dbb-cb68-4537-b547-7c038c77eed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:56.466739 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-92824dbb-cb68-4537-b547-7c038c77eed5 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:56.467951 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-92824dbb-cb68-4537-b547-7c038c77eed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:56.510153 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:56.548961 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 373/755] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:56 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:14:56.574623 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5970a-2c3d-4bf0-b32b-afeceac1788a None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:56.601436 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:56.677375 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5970a-2c3d-4bf0-b32b-afeceac1788a None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:56.711256 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a18ec-37ac-490c-b870-9cb34cde8796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:56.712063 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a18ec-37ac-490c-b870-9cb34cde8796 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:56.712336 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a18ec-37ac-490c-b870-9cb34cde8796 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:56.712598 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a18ec-37ac-490c-b870-9cb34cde8796 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:56.713245 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a18ec-37ac-490c-b870-9cb34cde8796 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:56.714645 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a18ec-37ac-490c-b870-9cb34cde8796 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:56.727228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-fa3a18ec-37ac-490c-b870-9cb34cde8796 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 17:14:56.727228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:56.727228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 17:14:56.727228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 17:14:56.727228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 17:14:56.727228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 17:14:56.727228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 17:14:56.727228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:14:56.727228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 17:14:56.727228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:56.727228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:14:56.727228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:56.727228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:14:56.727228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:14:56.727228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:14:56.727228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:14:56.728189 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:14:56.728189 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:14:56.728189 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:14:56.728189 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:14:56.728189 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:14:56.728189 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:14:56.728189 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:14:56.728189 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 17:14:56.728189 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 17:14:56.728189 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 17:14:56.728189 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 17:14:56.728189 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:14:56.728189 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:14:56.728189 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:14:56.728189 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:14:56.728189 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:14:56.729028 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:14:56.729028 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:14:56.729028 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:14:56.729028 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:14:56.729028 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:14:56.729028 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:14:56.729028 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:14:56.729028 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:14:56.729028 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:14:56.729028 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:14:56.729028 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:14:56.729028 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 17:14:56.729028 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:14:56.729028 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 17:14:56.729028 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:14:56.729028 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 383/756] 10.222.0.15 () {56 vars in 1132 bytes} [Fri Jun 24 17:14:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:14:56.734663 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92824dbb-cb68-4537-b547-7c038c77eed5 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:56.836513 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92824dbb-cb68-4537-b547-7c038c77eed5 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:56.870660 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95264346-5029-47f2-b196-5055a13fcf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:56.871240 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95264346-5029-47f2-b196-5055a13fcf78 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:56.871511 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95264346-5029-47f2-b196-5055a13fcf78 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:56.871775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95264346-5029-47f2-b196-5055a13fcf78 None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:56.872478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95264346-5029-47f2-b196-5055a13fcf78 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:56.872776 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95264346-5029-47f2-b196-5055a13fcf78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:56.874149 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95264346-5029-47f2-b196-5055a13fcf78 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:56.878850 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 374/757] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Jun 24 17:14:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:56.884696 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a18ec-37ac-490c-b870-9cb34cde8796 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:56.974816 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:56.992516 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a18ec-37ac-490c-b870-9cb34cde8796 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:57.028479 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fefb5f-03a4-42f6-8bd2-f04da25fbb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:57.029132 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fefb5f-03a4-42f6-8bd2-f04da25fbb34 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:57.029403 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fefb5f-03a4-42f6-8bd2-f04da25fbb34 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:57.029670 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fefb5f-03a4-42f6-8bd2-f04da25fbb34 None admin] PATH_INFO: `/v3/services` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:57.030363 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fefb5f-03a4-42f6-8bd2-f04da25fbb34 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:14:57.030690 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fefb5f-03a4-42f6-8bd2-f04da25fbb34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:57.032063 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fefb5f-03a4-42f6-8bd2-f04da25fbb34 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:57.037416 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 384/758] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Jun 24 17:14:56 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:14:58.661330 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958f4c7-eccf-4586-9f6c-7049e65524b0 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:58.661871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958f4c7-eccf-4586-9f6c-7049e65524b0 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:58.661871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958f4c7-eccf-4586-9f6c-7049e65524b0 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:58.663372 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 375/759] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:58.668782 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518460e4-18f3-4389-9efb-e26e0ac78aac None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:58.669183 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518460e4-18f3-4389-9efb-e26e0ac78aac None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:58.669366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518460e4-18f3-4389-9efb-e26e0ac78aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:58.687450 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-518460e4-18f3-4389-9efb-e26e0ac78aac None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:58.688622 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-518460e4-18f3-4389-9efb-e26e0ac78aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:58.763136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 385/760] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:58 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:14:58.788396 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958f4c7-eccf-4586-9f6c-7049e65524b0 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:58.827942 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:58.897954 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958f4c7-eccf-4586-9f6c-7049e65524b0 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:58.937559 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9452fa-b430-4c01-8b08-59b254caa6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:58.938224 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9452fa-b430-4c01-8b08-59b254caa6e5 None admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:58.938476 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9452fa-b430-4c01-8b08-59b254caa6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:58.938793 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9452fa-b430-4c01-8b08-59b254caa6e5 None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:58.939509 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9452fa-b430-4c01-8b08-59b254caa6e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:58.940931 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9452fa-b430-4c01-8b08-59b254caa6e5 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:58.956487 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 376/761] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 24 17:14:58 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:14:59.302332 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a240b5a-2667-4cec-adcb-58b0917ee355 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:59.302639 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a240b5a-2667-4cec-adcb-58b0917ee355 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:59.302940 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a240b5a-2667-4cec-adcb-58b0917ee355 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:59.304269 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 386/762] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:14:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:14:59.309764 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669341c-9cb5-45c9-a92e-a3bca6447fc1 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:59.310049 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669341c-9cb5-45c9-a92e-a3bca6447fc1 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:59.310328 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669341c-9cb5-45c9-a92e-a3bca6447fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:59.327772 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-8669341c-9cb5-45c9-a92e-a3bca6447fc1 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:14:59.328943 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-8669341c-9cb5-45c9-a92e-a3bca6447fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:14:59.403967 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 377/763] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:14:59 2022] POST /identity/v3/auth/tokens => generated 1497 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 17:14:59.428257 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a240b5a-2667-4cec-adcb-58b0917ee355 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:14:59.519371 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:14:59.541070 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a240b5a-2667-4cec-adcb-58b0917ee355 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:14:59.576308 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732fa9e-31cf-4229-874b-1298ebf07a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:14:59.576881 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732fa9e-31cf-4229-874b-1298ebf07a73 None admin] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:14:59.577160 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732fa9e-31cf-4229-874b-1298ebf07a73 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:14:59.577428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732fa9e-31cf-4229-874b-1298ebf07a73 None admin] PATH_INFO: `/v3/services` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:14:59.578142 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732fa9e-31cf-4229-874b-1298ebf07a73 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:14:59.579549 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732fa9e-31cf-4229-874b-1298ebf07a73 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:14:59.595188 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 387/764] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 24 17:14:59 2022] POST /identity/v3/services => generated 269 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:15:01.359454 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603083ef-a269-4533-8bcd-fa1501ebebf0 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:01.359978 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603083ef-a269-4533-8bcd-fa1501ebebf0 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:01.359978 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603083ef-a269-4533-8bcd-fa1501ebebf0 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:01.361239 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 378/765] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:15:01.366948 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67b55b-4b56-405b-a9b0-f467e9aa4d8a None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:01.367370 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67b55b-4b56-405b-a9b0-f467e9aa4d8a None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:01.367455 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67b55b-4b56-405b-a9b0-f467e9aa4d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:01.385037 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-8a67b55b-4b56-405b-a9b0-f467e9aa4d8a None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:15:01.386223 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-8a67b55b-4b56-405b-a9b0-f467e9aa4d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:15:01.460587 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 388/766] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:15:01 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:15:01.486731 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603083ef-a269-4533-8bcd-fa1501ebebf0 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:01.512616 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:01.593755 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603083ef-a269-4533-8bcd-fa1501ebebf0 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:01.632169 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71089c3-7c43-40dc-8d43-ae10fb82221f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:01.632760 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71089c3-7c43-40dc-8d43-ae10fb82221f None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:01.633054 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71089c3-7c43-40dc-8d43-ae10fb82221f None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:01.633307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71089c3-7c43-40dc-8d43-ae10fb82221f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:01.633972 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71089c3-7c43-40dc-8d43-ae10fb82221f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:01.635433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71089c3-7c43-40dc-8d43-ae10fb82221f None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:01.648631 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-a71089c3-7c43-40dc-8d43-ae10fb82221f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 17:15:01.648631 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:15:01.648631 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 17:15:01.648631 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 17:15:01.648631 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 17:15:01.648631 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 17:15:01.648631 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 17:15:01.648631 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:15:01.648631 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 17:15:01.648631 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:15:01.648631 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:15:01.648631 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:15:01.648631 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:15:01.648631 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:15:01.648631 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:15:01.648631 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:15:01.648631 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:15:01.649865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:15:01.649865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:15:01.649865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:15:01.649865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:15:01.649865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:15:01.649865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:15:01.649865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 17:15:01.649865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 17:15:01.649865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 17:15:01.649865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 17:15:01.649865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:15:01.649865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:15:01.649865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:15:01.649865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:15:01.649865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:15:01.649865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:15:01.650829 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:15:01.650829 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:15:01.650829 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:15:01.650829 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:15:01.650829 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:15:01.650829 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:15:01.650829 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:15:01.650829 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:15:01.650829 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:15:01.650829 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:15:01.650829 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 17:15:01.650829 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:15:01.650829 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 17:15:01.650829 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:15:01.650829 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 379/767] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 24 17:15:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:15:01.656378 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67b55b-4b56-405b-a9b0-f467e9aa4d8a None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:01.724316 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:01.762789 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67b55b-4b56-405b-a9b0-f467e9aa4d8a None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:01.798490 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7be6bb-2747-4def-9c32-7b340dd95249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:01.799181 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7be6bb-2747-4def-9c32-7b340dd95249 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:01.799516 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7be6bb-2747-4def-9c32-7b340dd95249 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:01.800344 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7be6bb-2747-4def-9c32-7b340dd95249 None admin] PATH_INFO: `/v3/services` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:01.801123 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7be6bb-2747-4def-9c32-7b340dd95249 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:15:01.801428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7be6bb-2747-4def-9c32-7b340dd95249 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:01.802839 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7be6bb-2747-4def-9c32-7b340dd95249 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:01.807805 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 389/768] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 24 17:15:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:15:01.813847 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71089c3-7c43-40dc-8d43-ae10fb82221f None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:01.880721 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96048eb4-0384-4c8d-a8e4-6d63354b7ac2 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:01.881051 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96048eb4-0384-4c8d-a8e4-6d63354b7ac2 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:01.881267 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96048eb4-0384-4c8d-a8e4-6d63354b7ac2 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:01.882772 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 390/769] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:15:01.887981 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c62bae-8740-433d-b08f-c6d716e7deba None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:01.888265 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c62bae-8740-433d-b08f-c6d716e7deba None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:01.888541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c62bae-8740-433d-b08f-c6d716e7deba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:01.905767 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-30c62bae-8740-433d-b08f-c6d716e7deba None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:15:01.906990 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-30c62bae-8740-433d-b08f-c6d716e7deba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:15:01.908366 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:01.924873 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71089c3-7c43-40dc-8d43-ae10fb82221f None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:01.964268 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3d502-5a1f-48a7-bf88-e580f8f3a009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:01.964920 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3d502-5a1f-48a7-bf88-e580f8f3a009 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:01.965191 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3d502-5a1f-48a7-bf88-e580f8f3a009 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:01.965458 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3d502-5a1f-48a7-bf88-e580f8f3a009 None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:01.966161 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3d502-5a1f-48a7-bf88-e580f8f3a009 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:15:01.966461 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3d502-5a1f-48a7-bf88-e580f8f3a009 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:01.967874 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3d502-5a1f-48a7-bf88-e580f8f3a009 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:01.973175 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 380/770] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 24 17:15:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:15:01.979073 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3d502-5a1f-48a7-bf88-e580f8f3a009 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:01.981338 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 391/771] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:15:01 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 17:15:02.005078 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c62bae-8740-433d-b08f-c6d716e7deba None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:02.066890 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:02.082372 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3d502-5a1f-48a7-bf88-e580f8f3a009 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:02.107732 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c62bae-8740-433d-b08f-c6d716e7deba None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:02.115481 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3f19c-0f98-4ba8-bf69-0e819d1b0705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:02.116158 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3f19c-0f98-4ba8-bf69-0e819d1b0705 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:02.116430 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3f19c-0f98-4ba8-bf69-0e819d1b0705 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:02.116698 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3f19c-0f98-4ba8-bf69-0e819d1b0705 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:02.117480 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3f19c-0f98-4ba8-bf69-0e819d1b0705 None admin] RBAC: Adding query filter params (interface=public, service_id=3c856e89682b472182fa5a8958a27393, region_id=RegionOne) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:15:02.117783 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3f19c-0f98-4ba8-bf69-0e819d1b0705 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:02.119181 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3f19c-0f98-4ba8-bf69-0e819d1b0705 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:02.124433 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 381/772] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Jun 24 17:15:01 2022] GET /identity/v3/endpoints?service_id=3c856e89682b472182fa5a8958a27393&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:15:02.129722 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3f19c-0f98-4ba8-bf69-0e819d1b0705 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:02.144778 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:02.145908 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb26601-4c78-4869-9a3a-c1d8b9f84b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:02.146991 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb26601-4c78-4869-9a3a-c1d8b9f84b31 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:02.147293 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb26601-4c78-4869-9a3a-c1d8b9f84b31 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:02.147667 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb26601-4c78-4869-9a3a-c1d8b9f84b31 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:02.148509 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb26601-4c78-4869-9a3a-c1d8b9f84b31 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:02.149710 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb26601-4c78-4869-9a3a-c1d8b9f84b31 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:02.162301 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-2eb26601-4c78-4869-9a3a-c1d8b9f84b31 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 17:15:02.162301 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:15:02.162301 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 17:15:02.162301 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 17:15:02.162301 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 17:15:02.162301 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 17:15:02.162301 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 17:15:02.162301 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:15:02.162301 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 17:15:02.162301 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:15:02.162301 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:15:02.162301 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:15:02.162301 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:15:02.162301 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:15:02.162301 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:15:02.162301 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:15:02.163506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:15:02.163506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:15:02.163506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:15:02.163506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:15:02.163506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:15:02.163506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:15:02.163506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:15:02.163506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 17:15:02.163506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 17:15:02.163506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 17:15:02.163506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 17:15:02.163506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:15:02.163506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:15:02.163506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:15:02.163506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:15:02.163506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:15:02.164607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:15:02.164607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:15:02.164607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:15:02.164607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:15:02.164607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:15:02.164607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:15:02.164607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:15:02.164607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:15:02.164607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:15:02.164607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:15:02.164607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:15:02.164607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 17:15:02.164607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:15:02.164607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 17:15:02.164607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:15:02.164607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 392/773] 10.222.0.15 () {56 vars in 1132 bytes} [Fri Jun 24 17:15:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:15:02.169497 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb26601-4c78-4869-9a3a-c1d8b9f84b31 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:02.231226 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3f19c-0f98-4ba8-bf69-0e819d1b0705 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:02.265344 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d9173-51c0-47b9-866b-9c767c200392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:02.266004 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d9173-51c0-47b9-866b-9c767c200392 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:02.266277 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d9173-51c0-47b9-866b-9c767c200392 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:02.266547 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d9173-51c0-47b9-866b-9c767c200392 None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:02.267254 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d9173-51c0-47b9-866b-9c767c200392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:02.268777 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d9173-51c0-47b9-866b-9c767c200392 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:02.270180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb26601-4c78-4869-9a3a-c1d8b9f84b31 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:02.275269 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 382/774] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Jun 24 17:15:02 2022] GET /identity/v3/services => generated 1498 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 17:15:02.294125 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:02.306425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9fe8b-68d9-4f19-b78e-3c197173f6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:02.307142 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9fe8b-68d9-4f19-b78e-3c197173f6ae None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:02.307419 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9fe8b-68d9-4f19-b78e-3c197173f6ae None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:02.307684 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9fe8b-68d9-4f19-b78e-3c197173f6ae None admin] PATH_INFO: `/v3/services` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:02.308395 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9fe8b-68d9-4f19-b78e-3c197173f6ae None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:15:02.308695 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9fe8b-68d9-4f19-b78e-3c197173f6ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:02.310096 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9fe8b-68d9-4f19-b78e-3c197173f6ae None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:02.315601 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 393/775] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Jun 24 17:15:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:15:02.321739 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d9173-51c0-47b9-866b-9c767c200392 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:02.406130 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:02.429267 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d9173-51c0-47b9-866b-9c767c200392 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:02.464310 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52498df-11c2-4cd5-9346-16a797d6196b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:02.464969 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52498df-11c2-4cd5-9346-16a797d6196b None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:02.465251 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52498df-11c2-4cd5-9346-16a797d6196b None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:02.465517 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52498df-11c2-4cd5-9346-16a797d6196b None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:02.466221 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52498df-11c2-4cd5-9346-16a797d6196b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:15:02.466496 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52498df-11c2-4cd5-9346-16a797d6196b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:02.467925 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52498df-11c2-4cd5-9346-16a797d6196b None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:02.474637 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 383/776] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Jun 24 17:15:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:15:02.480669 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9fe8b-68d9-4f19-b78e-3c197173f6ae None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:02.584854 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9fe8b-68d9-4f19-b78e-3c197173f6ae None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:02.620287 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d0add-43cc-4234-8706-cc633aa0e86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:02.620939 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d0add-43cc-4234-8706-cc633aa0e86c None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:02.621215 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d0add-43cc-4234-8706-cc633aa0e86c None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:02.621488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d0add-43cc-4234-8706-cc633aa0e86c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:02.622262 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d0add-43cc-4234-8706-cc633aa0e86c None admin] RBAC: Adding query filter params (interface=public, service_id=2df168c197f04a7d9608ace5b51b3c5d, region_id=RegionOne) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:15:02.622590 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d0add-43cc-4234-8706-cc633aa0e86c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:02.623961 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d0add-43cc-4234-8706-cc633aa0e86c None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:02.629357 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 394/777] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Jun 24 17:15:02 2022] GET /identity/v3/endpoints?service_id=2df168c197f04a7d9608ace5b51b3c5d&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:15:02.635008 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52498df-11c2-4cd5-9346-16a797d6196b None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:02.734128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52498df-11c2-4cd5-9346-16a797d6196b None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:02.767942 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f8186-be02-4c8c-9794-6f3738b18ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:02.768652 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f8186-be02-4c8c-9794-6f3738b18ba1 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:02.768926 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f8186-be02-4c8c-9794-6f3738b18ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:02.769201 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f8186-be02-4c8c-9794-6f3738b18ba1 None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:02.769872 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f8186-be02-4c8c-9794-6f3738b18ba1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:02.771350 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f8186-be02-4c8c-9794-6f3738b18ba1 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:02.777553 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 384/778] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Jun 24 17:15:02 2022] GET /identity/v3/services => generated 1498 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 17:15:04.572516 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52938d6b-322a-423e-9d1f-8a75411b121e None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:04.573078 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52938d6b-322a-423e-9d1f-8a75411b121e None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:04.573078 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52938d6b-322a-423e-9d1f-8a75411b121e None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:04.574369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 395/779] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:15:04.579743 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac84fa-7484-4246-a7d3-17c5ca08213d None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:04.580170 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac84fa-7484-4246-a7d3-17c5ca08213d None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:04.580312 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac84fa-7484-4246-a7d3-17c5ca08213d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:04.593226 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:04.600334 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-c8ac84fa-7484-4246-a7d3-17c5ca08213d None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:15:04.601541 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-c8ac84fa-7484-4246-a7d3-17c5ca08213d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:15:04.674166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 385/780] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:15:04 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:15:04.699020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52938d6b-322a-423e-9d1f-8a75411b121e None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:04.755451 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:04.804802 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52938d6b-322a-423e-9d1f-8a75411b121e None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:04.844220 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68f3a9-ecdf-4929-a02d-c79924356b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:04.844929 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68f3a9-ecdf-4929-a02d-c79924356b11 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:04.845204 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68f3a9-ecdf-4929-a02d-c79924356b11 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:04.845476 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68f3a9-ecdf-4929-a02d-c79924356b11 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:04.846369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68f3a9-ecdf-4929-a02d-c79924356b11 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:04.848069 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68f3a9-ecdf-4929-a02d-c79924356b11 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:04.860095 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-ee68f3a9-ecdf-4929-a02d-c79924356b11 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 17:15:04.860095 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:15:04.860095 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 17:15:04.860095 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 17:15:04.860095 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 17:15:04.860095 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 17:15:04.860095 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 17:15:04.860095 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:15:04.860095 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 17:15:04.860095 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:15:04.860095 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:15:04.860095 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:15:04.860095 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:15:04.860095 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:15:04.860095 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:15:04.860095 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:15:04.860095 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:15:04.861113 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:15:04.861113 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:15:04.861113 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:15:04.861113 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:15:04.861113 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:15:04.861113 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:15:04.861113 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 17:15:04.861113 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 17:15:04.861113 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 17:15:04.861113 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 17:15:04.861113 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:15:04.861113 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:15:04.861113 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:15:04.861113 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:15:04.861113 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:15:04.861113 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:15:04.862042 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:15:04.862042 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:15:04.862042 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:15:04.862042 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:15:04.862042 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:15:04.862042 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:15:04.862042 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:15:04.862042 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:15:04.862042 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:15:04.862042 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:15:04.862042 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 17:15:04.862042 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:15:04.862042 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 17:15:04.862042 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:15:04.862042 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 396/781] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 24 17:15:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:15:04.867452 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac84fa-7484-4246-a7d3-17c5ca08213d None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:04.971962 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac84fa-7484-4246-a7d3-17c5ca08213d None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:05.008540 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0fabc-c1f2-441b-8248-55c904589314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:05.009213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0fabc-c1f2-441b-8248-55c904589314 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:05.009482 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0fabc-c1f2-441b-8248-55c904589314 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:05.009747 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0fabc-c1f2-441b-8248-55c904589314 None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:05.010509 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0fabc-c1f2-441b-8248-55c904589314 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:15:05.010838 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0fabc-c1f2-441b-8248-55c904589314 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:05.012216 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0fabc-c1f2-441b-8248-55c904589314 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:05.014373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:05.018039 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 386/782] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 24 17:15:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:15:05.023645 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68f3a9-ecdf-4929-a02d-c79924356b11 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:05.052068 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ad436-9620-4475-933c-0e6bfc01996b None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:05.052357 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ad436-9620-4475-933c-0e6bfc01996b None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:05.052633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ad436-9620-4475-933c-0e6bfc01996b None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:05.053995 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 387/783] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:15:05.058781 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4301339-e642-4385-9e73-84c582886f1d None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:05.059062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4301339-e642-4385-9e73-84c582886f1d None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:05.059330 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4301339-e642-4385-9e73-84c582886f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:05.075869 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-d4301339-e642-4385-9e73-84c582886f1d None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:15:05.077044 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-d4301339-e642-4385-9e73-84c582886f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:15:05.127037 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68f3a9-ecdf-4929-a02d-c79924356b11 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:05.143215 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:05.145961 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 388/784] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:15:05 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:15:05.161629 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837af5c-10c0-4ce8-a802-2879bded72b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:05.162287 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837af5c-10c0-4ce8-a802-2879bded72b2 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:05.162557 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837af5c-10c0-4ce8-a802-2879bded72b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:05.162865 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837af5c-10c0-4ce8-a802-2879bded72b2 None admin] PATH_INFO: `/v3/services` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:05.163553 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837af5c-10c0-4ce8-a802-2879bded72b2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:15:05.163873 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837af5c-10c0-4ce8-a802-2879bded72b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:05.165218 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837af5c-10c0-4ce8-a802-2879bded72b2 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:05.169932 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 397/785] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 24 17:15:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:15:05.171076 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4301339-e642-4385-9e73-84c582886f1d None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:05.175546 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837af5c-10c0-4ce8-a802-2879bded72b2 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:05.273312 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4301339-e642-4385-9e73-84c582886f1d None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:05.276908 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837af5c-10c0-4ce8-a802-2879bded72b2 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:05.304464 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:05.311514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023cab7-87cd-45b6-abdb-a7921efcd1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:05.312339 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023cab7-87cd-45b6-abdb-a7921efcd1da None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:05.312603 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023cab7-87cd-45b6-abdb-a7921efcd1da None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:05.312876 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023cab7-87cd-45b6-abdb-a7921efcd1da None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:05.313574 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023cab7-87cd-45b6-abdb-a7921efcd1da None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:05.314311 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71d65d-69e7-4941-820b-104332fc0850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:05.315245 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023cab7-87cd-45b6-abdb-a7921efcd1da None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:05.315370 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71d65d-69e7-4941-820b-104332fc0850 None admin] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:05.315555 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71d65d-69e7-4941-820b-104332fc0850 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:05.315830 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71d65d-69e7-4941-820b-104332fc0850 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:05.316557 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71d65d-69e7-4941-820b-104332fc0850 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:05.317917 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71d65d-69e7-4941-820b-104332fc0850 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:05.327858 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-0023cab7-87cd-45b6-abdb-a7921efcd1da None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 17:15:05.327858 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:15:05.327858 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 17:15:05.327858 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 17:15:05.327858 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 17:15:05.327858 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 17:15:05.327858 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 17:15:05.327858 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:15:05.327858 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 17:15:05.327858 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:15:05.327858 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:15:05.327858 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:15:05.327858 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:15:05.327858 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:15:05.327858 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:15:05.327858 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:15:05.328857 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:15:05.328857 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:15:05.328857 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:15:05.328857 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:15:05.328857 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:15:05.328857 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:15:05.328857 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:15:05.328857 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 17:15:05.328857 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 17:15:05.328857 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 17:15:05.328857 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 17:15:05.328857 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:15:05.328857 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:15:05.328857 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:15:05.328857 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:15:05.328857 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:15:05.329686 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:15:05.329686 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:15:05.329686 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:15:05.329686 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:15:05.329686 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:15:05.329686 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:15:05.329686 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:15:05.329686 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:15:05.329686 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:15:05.329686 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:15:05.329686 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:15:05.329686 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 17:15:05.329686 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:15:05.329686 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 17:15:05.329686 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:15:05.329686 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 389/786] 10.222.0.15 () {56 vars in 1132 bytes} [Fri Jun 24 17:15:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:15:05.335802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023cab7-87cd-45b6-abdb-a7921efcd1da None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:05.336846 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 398/787] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Jun 24 17:15:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 17:15:05.444746 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023cab7-87cd-45b6-abdb-a7921efcd1da None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:05.487512 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7e4e9-c979-47a2-836e-bde9d5aae179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:05.488184 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7e4e9-c979-47a2-836e-bde9d5aae179 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:05.488463 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7e4e9-c979-47a2-836e-bde9d5aae179 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:05.488734 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7e4e9-c979-47a2-836e-bde9d5aae179 None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:05.489436 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7e4e9-c979-47a2-836e-bde9d5aae179 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:15:05.489733 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7e4e9-c979-47a2-836e-bde9d5aae179 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:05.491177 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7e4e9-c979-47a2-836e-bde9d5aae179 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:05.496401 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 390/788] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Jun 24 17:15:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:15:05.502383 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71d65d-69e7-4941-820b-104332fc0850 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:05.540566 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:05.606053 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71d65d-69e7-4941-820b-104332fc0850 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:05.640442 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c005067-432a-4abc-b927-6af48baff337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:05.641106 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c005067-432a-4abc-b927-6af48baff337 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:05.641377 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c005067-432a-4abc-b927-6af48baff337 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:05.641640 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c005067-432a-4abc-b927-6af48baff337 None admin] PATH_INFO: `/v3/services` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:05.642336 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c005067-432a-4abc-b927-6af48baff337 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:15:05.642672 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c005067-432a-4abc-b927-6af48baff337 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:05.644714 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c005067-432a-4abc-b927-6af48baff337 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:05.649934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 399/789] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Jun 24 17:15:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:15:05.655762 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7e4e9-c979-47a2-836e-bde9d5aae179 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:05.711749 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:05.755928 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7e4e9-c979-47a2-836e-bde9d5aae179 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:05.789470 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ce025-ebde-4ff9-96b6-99dd9cc82a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:05.790119 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ce025-ebde-4ff9-96b6-99dd9cc82a26 None admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:05.790391 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ce025-ebde-4ff9-96b6-99dd9cc82a26 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:05.790685 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ce025-ebde-4ff9-96b6-99dd9cc82a26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:05.791418 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ce025-ebde-4ff9-96b6-99dd9cc82a26 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:05.792785 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ce025-ebde-4ff9-96b6-99dd9cc82a26 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:05.812196 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 391/790] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Jun 24 17:15:05 2022] POST /identity/v3/endpoints => generated 347 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:15:07.664013 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c89b82-6586-49cc-acbe-cefed6cef5d0 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:07.664606 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c89b82-6586-49cc-acbe-cefed6cef5d0 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:07.664606 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c89b82-6586-49cc-acbe-cefed6cef5d0 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:07.666086 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 400/791] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:15:07.671385 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3b2a9-7da4-4818-9063-187f13fe5c40 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:07.671798 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3b2a9-7da4-4818-9063-187f13fe5c40 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:07.672068 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3b2a9-7da4-4818-9063-187f13fe5c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:07.689902 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-b4a3b2a9-7da4-4818-9063-187f13fe5c40 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:15:07.691298 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-b4a3b2a9-7da4-4818-9063-187f13fe5c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:15:07.765935 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 392/792] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:15:07 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:15:07.790231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c89b82-6586-49cc-acbe-cefed6cef5d0 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:07.894592 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:07.898794 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c89b82-6586-49cc-acbe-cefed6cef5d0 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:07.934229 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920d1fb-fcf5-4bf8-8c07-050f4cba855e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:07.934916 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920d1fb-fcf5-4bf8-8c07-050f4cba855e None admin] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:07.935188 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920d1fb-fcf5-4bf8-8c07-050f4cba855e None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:07.935451 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920d1fb-fcf5-4bf8-8c07-050f4cba855e None admin] PATH_INFO: `/v3/projects` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:07.936134 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920d1fb-fcf5-4bf8-8c07-050f4cba855e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:07.937554 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920d1fb-fcf5-4bf8-8c07-050f4cba855e None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:07.938936 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: WARNING keystone.server.flask.common [None req-c920d1fb-fcf5-4bf8-8c07-050f4cba855e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 24 17:15:07.956750 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.sql.core [None req-c920d1fb-fcf5-4bf8-8c07-050f4cba855e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 17:15:07.956750 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 17:15:07.956750 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [parameters: {'id': '75e992c3f84b4a99ae820796f20ac498', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 17:15:07.956750 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87096) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 17:15:07.973687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-c920d1fb-fcf5-4bf8-8c07-050f4cba855e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 75e992c3f84b4a99ae820796f20ac498.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 75e992c3f84b4a99ae820796f20ac498. Jun 24 17:15:07.973687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:15:07.973687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 17:15:07.973687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 17:15:07.973687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 17:15:07.973687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 17:15:07.973687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 17:15:07.973687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 17:15:07.973687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 17:15:07.973687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application conn.query(q) Jun 24 17:15:07.973687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 17:15:07.973687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 17:15:07.973687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 17:15:07.974595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application result.read() Jun 24 17:15:07.974595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 17:15:07.974595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 17:15:07.974595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 17:15:07.974595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 17:15:07.974595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 17:15:07.974595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 17:15:07.974595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 17:15:07.974595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 17:15:07.974595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 17:15:07.974595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:15:07.974595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 17:15:07.974595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:15:07.974595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:15:07.974595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 17:15:07.974595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 17:15:07.974595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 24 17:15:07.974595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 24 17:15:07.975824 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 17:15:07.975824 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application next(self.gen) Jun 24 17:15:07.975824 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 17:15:07.975824 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application yield resource Jun 24 17:15:07.975824 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 17:15:07.975824 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application next(self.gen) Jun 24 17:15:07.975824 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 17:15:07.975824 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 17:15:07.975824 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 17:15:07.975824 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 17:15:07.975824 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 17:15:07.975824 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise self.value Jun 24 17:15:07.975824 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 17:15:07.975824 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 17:15:07.975824 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 17:15:07.975824 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application session.commit() Jun 24 17:15:07.975824 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 17:15:07.976993 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 17:15:07.976993 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 17:15:07.976993 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 17:15:07.976993 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 17:15:07.976993 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application self.session.flush() Jun 24 17:15:07.976993 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 17:15:07.976993 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 17:15:07.976993 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 17:15:07.976993 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 17:15:07.976993 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 17:15:07.976993 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application compat.raise_( Jun 24 17:15:07.976993 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 17:15:07.976993 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception Jun 24 17:15:07.976993 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 17:15:07.976993 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 17:15:07.976993 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 17:15:07.976993 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 17:15:07.977949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 17:15:07.977949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 17:15:07.977949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 17:15:07.977949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 17:15:07.977949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 24 17:15:07.977949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 24 17:15:07.977949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 17:15:07.977949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 17:15:07.977949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 17:15:07.977949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 17:15:07.977949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 17:15:07.977949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 17:15:07.977949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 17:15:07.977949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 17:15:07.977949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 17:15:07.978801 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 17:15:07.978801 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 17:15:07.978801 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception Jun 24 17:15:07.978801 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 17:15:07.978801 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 17:15:07.978801 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 17:15:07.978801 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 17:15:07.978801 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 17:15:07.978801 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 17:15:07.978801 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 17:15:07.978801 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application conn.query(q) Jun 24 17:15:07.978801 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 17:15:07.978801 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 17:15:07.978801 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 17:15:07.978801 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application result.read() Jun 24 17:15:07.978801 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 17:15:07.978801 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 17:15:07.980369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 17:15:07.980369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 17:15:07.980369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 17:15:07.980369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 17:15:07.980369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 17:15:07.980369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 17:15:07.980369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 17:15:07.980369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 17:15:07.980369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [parameters: {'id': '75e992c3f84b4a99ae820796f20ac498', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 17:15:07.980369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 17:15:07.980369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:15:07.980369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:15:07.980369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:15:07.980369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:15:07.980369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 24 17:15:07.981949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 24 17:15:07.981949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 17:15:07.981949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 17:15:07.981949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 24 17:15:07.981949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:15:07.981949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:15:07.981949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:15:07.981949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:15:07.981949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:15:07.981949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:15:07.981949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:15:07.981949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:15:07.981949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:15:07.981949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:15:07.981949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:15:07.981949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:15:07.981949 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:15:07.983701 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:15:07.983701 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 24 17:15:07.983701 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 24 17:15:07.983701 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:15:07.983701 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:15:07.983701 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 24 17:15:07.983701 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 24 17:15:07.983701 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 75e992c3f84b4a99ae820796f20ac498. Jun 24 17:15:07.983701 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:15:07.983701 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 401/793] 10.222.0.15 () {60 vars in 1140 bytes} [Fri Jun 24 17:15:07 2022] POST /identity/v3/projects => generated 262 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:15:07.984393 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3b2a9-7da4-4818-9063-187f13fe5c40 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:08.018557 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:08.090948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3b2a9-7da4-4818-9063-187f13fe5c40 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:08.101344 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff9293-c36c-497b-9c13-7a926944c02a None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:08.101627 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff9293-c36c-497b-9c13-7a926944c02a None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:08.101906 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff9293-c36c-497b-9c13-7a926944c02a None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:08.106159 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 402/794] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:15:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:15:08.111212 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320f8c5-9596-4a8f-ba24-818c788da32e None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:08.111676 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320f8c5-9596-4a8f-ba24-818c788da32e None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:08.112335 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320f8c5-9596-4a8f-ba24-818c788da32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:08.127586 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934e566-ccdb-4919-a5e8-ce9236566f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:08.128385 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934e566-ccdb-4919-a5e8-ce9236566f69 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:08.128658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934e566-ccdb-4919-a5e8-ce9236566f69 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:08.128924 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934e566-ccdb-4919-a5e8-ce9236566f69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:08.130171 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-0320f8c5-9596-4a8f-ba24-818c788da32e None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:15:08.131735 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-0320f8c5-9596-4a8f-ba24-818c788da32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:15:08.135644 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934e566-ccdb-4919-a5e8-ce9236566f69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:08.137090 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934e566-ccdb-4919-a5e8-ce9236566f69 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:08.150611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-a934e566-ccdb-4919-a5e8-ce9236566f69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:15:08.150611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:15:08.150611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:15:08.150611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:15:08.150611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:15:08.150611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:15:08.150611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:15:08.150611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:15:08.150611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:15:08.150611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:15:08.150611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:15:08.150611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:15:08.150611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 17:15:08.150611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 17:15:08.150611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 17:15:08.151678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 17:15:08.151678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:15:08.151678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:15:08.151678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:15:08.151678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:15:08.151678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:15:08.151678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:15:08.151678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:15:08.151678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:15:08.151678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:15:08.151678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:15:08.151678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:15:08.151678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:15:08.151678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:15:08.151678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:15:08.151678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:15:08.151678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:15:08.157439 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 17:15:08.157439 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 17:15:08.157439 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 17:15:08.157439 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 17:15:08.157439 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 17:15:08.157439 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 17:15:08.157439 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:15:08.157439 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:15:08.157439 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 393/795] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:15:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:15:08.157939 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934e566-ccdb-4919-a5e8-ce9236566f69 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:08.202188 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 403/796] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:15:08 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:15:08.226108 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320f8c5-9596-4a8f-ba24-818c788da32e None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:08.262476 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:08.269337 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934e566-ccdb-4919-a5e8-ce9236566f69 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:08.303394 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64518da-e6ec-45c1-8e0b-24279c68fd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:08.304051 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64518da-e6ec-45c1-8e0b-24279c68fd53 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:08.304330 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64518da-e6ec-45c1-8e0b-24279c68fd53 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:08.304599 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64518da-e6ec-45c1-8e0b-24279c68fd53 None admin] PATH_INFO: `/v3/projects` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:08.305352 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64518da-e6ec-45c1-8e0b-24279c68fd53 None admin] RBAC: Adding query filter params (name=service) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:15:08.305654 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64518da-e6ec-45c1-8e0b-24279c68fd53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:08.307131 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64518da-e6ec-45c1-8e0b-24279c68fd53 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:08.317775 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:08.324826 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 394/797] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 24 17:15:08 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:15:08.334627 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320f8c5-9596-4a8f-ba24-818c788da32e None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:08.374128 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccf5ea-716a-469c-9b6c-91beb027136c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:08.374984 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccf5ea-716a-469c-9b6c-91beb027136c None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:08.375260 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccf5ea-716a-469c-9b6c-91beb027136c None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:08.375526 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccf5ea-716a-469c-9b6c-91beb027136c None admin] PATH_INFO: `/v3/services/compute` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:08.376180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccf5ea-716a-469c-9b6c-91beb027136c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:08.377788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccf5ea-716a-469c-9b6c-91beb027136c None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:08.390457 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-8eccf5ea-716a-469c-9b6c-91beb027136c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 17:15:08.390457 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:15:08.390457 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 17:15:08.390457 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 17:15:08.390457 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 17:15:08.390457 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 17:15:08.390457 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 17:15:08.390457 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:15:08.390457 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 17:15:08.390457 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:15:08.390457 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:15:08.390457 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:15:08.390457 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:15:08.390457 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:15:08.390457 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:15:08.390457 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:15:08.390457 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:15:08.391569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:15:08.391569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:15:08.391569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:15:08.391569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:15:08.391569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:15:08.391569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:15:08.391569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 17:15:08.391569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 17:15:08.391569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 17:15:08.391569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 17:15:08.391569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:15:08.391569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:15:08.391569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:15:08.391569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:15:08.391569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:15:08.391569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:15:08.392401 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:15:08.392401 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:15:08.392401 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:15:08.392401 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:15:08.392401 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:15:08.392401 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:15:08.392401 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:15:08.392401 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:15:08.392401 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:15:08.392401 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:15:08.392401 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 17:15:08.392401 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:15:08.392401 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 17:15:08.392401 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:15:08.392401 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 404/798] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:15:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:15:08.398754 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64518da-e6ec-45c1-8e0b-24279c68fd53 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:08.508125 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64518da-e6ec-45c1-8e0b-24279c68fd53 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:08.542512 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5bc27-6d93-40f1-9fc2-57cb57bd3dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:08.543221 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5bc27-6d93-40f1-9fc2-57cb57bd3dcb None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:08.543495 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5bc27-6d93-40f1-9fc2-57cb57bd3dcb None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:08.543762 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5bc27-6d93-40f1-9fc2-57cb57bd3dcb None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:08.544461 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5bc27-6d93-40f1-9fc2-57cb57bd3dcb None admin] RBAC: Adding query filter params (name=compute) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:15:08.544761 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5bc27-6d93-40f1-9fc2-57cb57bd3dcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:08.546130 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5bc27-6d93-40f1-9fc2-57cb57bd3dcb None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:08.551460 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 395/799] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 24 17:15:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:15:08.559159 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccf5ea-716a-469c-9b6c-91beb027136c None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:08.670445 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccf5ea-716a-469c-9b6c-91beb027136c None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:08.715653 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e55716-26de-4a3c-80e4-408d3553d934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:08.716357 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e55716-26de-4a3c-80e4-408d3553d934 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:08.716595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e55716-26de-4a3c-80e4-408d3553d934 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:08.716897 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e55716-26de-4a3c-80e4-408d3553d934 None admin] PATH_INFO: `/v3/services` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:08.717571 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e55716-26de-4a3c-80e4-408d3553d934 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:15:08.717873 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e55716-26de-4a3c-80e4-408d3553d934 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:08.719355 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e55716-26de-4a3c-80e4-408d3553d934 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:08.725679 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 405/800] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 24 17:15:08 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:15:10.656587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb700cc1-8dd9-49fd-9b74-4795ecbca077 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:10.657145 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb700cc1-8dd9-49fd-9b74-4795ecbca077 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:10.657145 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb700cc1-8dd9-49fd-9b74-4795ecbca077 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:10.658564 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 396/801] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:15:10.663904 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c714b9-7224-4b5e-83ce-efdd19e740d9 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:10.664305 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c714b9-7224-4b5e-83ce-efdd19e740d9 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:10.664488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c714b9-7224-4b5e-83ce-efdd19e740d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:10.683464 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-58c714b9-7224-4b5e-83ce-efdd19e740d9 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:15:10.684821 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-58c714b9-7224-4b5e-83ce-efdd19e740d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:15:10.700955 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:10.771387 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 406/802] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:15:10 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:15:10.797665 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb700cc1-8dd9-49fd-9b74-4795ecbca077 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:10.820427 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:10.904439 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb700cc1-8dd9-49fd-9b74-4795ecbca077 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:10.939001 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d506301-5566-45c9-b5d7-1f34ba9ce9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:10.939775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d506301-5566-45c9-b5d7-1f34ba9ce9b7 None admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:10.940057 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d506301-5566-45c9-b5d7-1f34ba9ce9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:10.940327 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d506301-5566-45c9-b5d7-1f34ba9ce9b7 None admin] PATH_INFO: `/v3/users` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:10.941033 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d506301-5566-45c9-b5d7-1f34ba9ce9b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:10.942480 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d506301-5566-45c9-b5d7-1f34ba9ce9b7 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:10.943817 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: WARNING keystone.server.flask.common [None req-8d506301-5566-45c9-b5d7-1f34ba9ce9b7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 24 17:15:10.956824 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.sql.core [None req-8d506301-5566-45c9-b5d7-1f34ba9ce9b7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 17:15:10.956824 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 17:15:10.956824 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [parameters: {'user_id': '9be74ff9c2214467a97b6b3c4d1c70e1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 17:15:10.956824 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87095) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 17:15:10.967027 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8d6b3-34e7-4cb9-bbeb-5119dd28e691 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:10.967411 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8d6b3-34e7-4cb9-bbeb-5119dd28e691 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:10.967770 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8d6b3-34e7-4cb9-bbeb-5119dd28e691 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:10.969205 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 407/803] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:15:10.973609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-8d506301-5566-45c9-b5d7-1f34ba9ce9b7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 17:15:10.973609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:15:10.973609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 17:15:10.973609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 17:15:10.973609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 17:15:10.973609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 17:15:10.973609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 17:15:10.973609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 17:15:10.973609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 17:15:10.973609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application conn.query(q) Jun 24 17:15:10.973609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 17:15:10.973609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 17:15:10.973609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 17:15:10.973609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application result.read() Jun 24 17:15:10.973609 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 17:15:10.974676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 17:15:10.974676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 17:15:10.974676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 17:15:10.974676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 17:15:10.974676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 17:15:10.974676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 17:15:10.974676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 17:15:10.974676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 17:15:10.974676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:15:10.974676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 17:15:10.974676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:15:10.974676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:15:10.974676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 17:15:10.974676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 17:15:10.974676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 24 17:15:10.974676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 24 17:15:10.974676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 17:15:10.974676 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application next(self.gen) Jun 24 17:15:10.975867 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 17:15:10.975867 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application yield resource Jun 24 17:15:10.975867 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 17:15:10.975867 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application next(self.gen) Jun 24 17:15:10.975867 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 17:15:10.975867 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 17:15:10.975867 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 17:15:10.975867 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 17:15:10.975867 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 17:15:10.975867 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise self.value Jun 24 17:15:10.975867 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 17:15:10.975867 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 17:15:10.975867 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 17:15:10.975867 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application session.commit() Jun 24 17:15:10.975867 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 17:15:10.975867 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 17:15:10.975867 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 17:15:10.976794 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 17:15:10.976794 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 17:15:10.976794 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application self.session.flush() Jun 24 17:15:10.976794 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 17:15:10.976794 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 17:15:10.976794 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 17:15:10.976794 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 17:15:10.976794 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 17:15:10.976794 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application compat.raise_( Jun 24 17:15:10.976794 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 17:15:10.976794 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception Jun 24 17:15:10.976794 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 17:15:10.976794 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 17:15:10.976794 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 17:15:10.976794 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 17:15:10.976794 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 17:15:10.976794 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 17:15:10.977708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 17:15:10.977708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 17:15:10.977708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 24 17:15:10.977708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 24 17:15:10.977708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 17:15:10.977708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 17:15:10.977708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 17:15:10.977708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 17:15:10.977708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 17:15:10.977708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 17:15:10.977708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 17:15:10.977708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 17:15:10.977708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 17:15:10.977708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 17:15:10.977708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 17:15:10.977708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception Jun 24 17:15:10.978526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 17:15:10.978526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 17:15:10.978526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 17:15:10.978526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 17:15:10.978526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 17:15:10.978526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 17:15:10.978526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 17:15:10.978526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application conn.query(q) Jun 24 17:15:10.978526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 17:15:10.978526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 17:15:10.978526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 17:15:10.978526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application result.read() Jun 24 17:15:10.978526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 17:15:10.978526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 17:15:10.978526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 17:15:10.978526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 17:15:10.979386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 17:15:10.979386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 17:15:10.979386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 17:15:10.979386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 17:15:10.979386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 17:15:10.979386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 17:15:10.979386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [parameters: {'user_id': '9be74ff9c2214467a97b6b3c4d1c70e1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 17:15:10.979386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 17:15:10.979386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:15:10.979386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:15:10.979386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:15:10.979386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:15:10.979386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:15:10.979386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:15:10.979386 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:15:10.980735 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:15:10.980735 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:15:10.980735 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:15:10.980735 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:15:10.980735 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:15:10.980735 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:15:10.980735 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:15:10.980735 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 24 17:15:10.980735 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 24 17:15:10.980735 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:15:10.980735 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:15:10.980735 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 17:15:10.980735 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:15:10.980735 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 17:15:10.980735 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:15:10.980735 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 24 17:15:10.980735 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 24 17:15:10.981822 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 24 17:15:10.981822 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 24 17:15:10.981822 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 17:15:10.981822 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 17:15:10.981822 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 17:15:10.981822 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:15:10.981822 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 397/804] 10.222.0.15 () {60 vars in 1131 bytes} [Fri Jun 24 17:15:10 2022] POST /identity/v3/users => generated 160 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:15:10.982495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249d5a4-d364-4cd2-b279-602d3a9d07ee None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:10.982495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249d5a4-d364-4cd2-b279-602d3a9d07ee None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:10.982495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249d5a4-d364-4cd2-b279-602d3a9d07ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:10.982796 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d506301-5566-45c9-b5d7-1f34ba9ce9b7 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:10.995042 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-f249d5a4-d364-4cd2-b279-602d3a9d07ee None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:15:10.996237 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-f249d5a4-d364-4cd2-b279-602d3a9d07ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:15:11.070606 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 408/805] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:15:10 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:15:11.074865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:11.092004 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249d5a4-d364-4cd2-b279-602d3a9d07ee None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:11.094120 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d506301-5566-45c9-b5d7-1f34ba9ce9b7 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:11.132662 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b2587-b4df-42c8-a20a-2fa249bc8ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:11.133458 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b2587-b4df-42c8-a20a-2fa249bc8ac5 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:11.133735 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b2587-b4df-42c8-a20a-2fa249bc8ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:11.134003 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b2587-b4df-42c8-a20a-2fa249bc8ac5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:11.141771 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b2587-b4df-42c8-a20a-2fa249bc8ac5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:11.143685 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b2587-b4df-42c8-a20a-2fa249bc8ac5 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:11.157633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-177b2587-b4df-42c8-a20a-2fa249bc8ac5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 17:15:11.157633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:15:11.157633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:15:11.157633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:15:11.157633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:15:11.157633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:15:11.157633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:15:11.157633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:15:11.157633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:15:11.157633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:15:11.157633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:15:11.157633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:15:11.157633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 17:15:11.157633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 17:15:11.157633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 17:15:11.157633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 17:15:11.159092 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:15:11.159092 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:15:11.159092 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 17:15:11.159092 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:15:11.159092 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 17:15:11.159092 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:15:11.159092 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:15:11.159092 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:15:11.159092 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:15:11.159092 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:15:11.159092 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:15:11.159092 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:15:11.159092 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:15:11.159092 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:15:11.159092 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:15:11.159092 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:15:11.159092 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:15:11.159092 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:15:11.160050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:15:11.160050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:15:11.160050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 17:15:11.160050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 17:15:11.160050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 17:15:11.160050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 17:15:11.160050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 17:15:11.160050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 17:15:11.160050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 17:15:11.160050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:15:11.160050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 398/806] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:15:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:15:11.165025 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b2587-b4df-42c8-a20a-2fa249bc8ac5 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:11.168621 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:11.211988 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249d5a4-d364-4cd2-b279-602d3a9d07ee None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:11.248943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6656b4-7092-4f88-b46a-4f9bc5f14849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:11.249608 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6656b4-7092-4f88-b46a-4f9bc5f14849 None admin] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:11.249881 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6656b4-7092-4f88-b46a-4f9bc5f14849 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:11.250156 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6656b4-7092-4f88-b46a-4f9bc5f14849 None admin] PATH_INFO: `/v3/services` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:11.250907 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6656b4-7092-4f88-b46a-4f9bc5f14849 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:11.252337 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6656b4-7092-4f88-b46a-4f9bc5f14849 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:11.268986 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 409/807] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 24 17:15:11 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:15:11.287245 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b2587-b4df-42c8-a20a-2fa249bc8ac5 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:11.336342 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9790f-d41c-4246-9990-8e54a5652725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:11.337028 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9790f-d41c-4246-9990-8e54a5652725 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:11.337297 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9790f-d41c-4246-9990-8e54a5652725 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:11.337566 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9790f-d41c-4246-9990-8e54a5652725 None admin] PATH_INFO: `/v3/users` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:11.338389 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9790f-d41c-4246-9990-8e54a5652725 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:15:11.338723 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9790f-d41c-4246-9990-8e54a5652725 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:11.340229 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9790f-d41c-4246-9990-8e54a5652725 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:11.360618 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:11.382859 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 399/808] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 24 17:15:11 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:15:13.572800 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cba8c8-9382-40ee-9cca-7cc004ffd3fc None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:13.573667 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cba8c8-9382-40ee-9cca-7cc004ffd3fc None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:13.573667 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cba8c8-9382-40ee-9cca-7cc004ffd3fc None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:13.575857 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 410/809] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:15:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:15:13.582129 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb82ef-1636-4d63-9455-6c2fa23e0a63 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:13.582549 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb82ef-1636-4d63-9455-6c2fa23e0a63 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:13.582717 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb82ef-1636-4d63-9455-6c2fa23e0a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:13.606235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-d8eb82ef-1636-4d63-9455-6c2fa23e0a63 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:15:13.607833 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-d8eb82ef-1636-4d63-9455-6c2fa23e0a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:15:13.681367 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 400/810] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:15:13 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:15:13.715111 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cba8c8-9382-40ee-9cca-7cc004ffd3fc None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:13.829678 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cba8c8-9382-40ee-9cca-7cc004ffd3fc None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:13.868528 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba586a53-8749-426a-b98d-f302d902df37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:13.869301 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba586a53-8749-426a-b98d-f302d902df37 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:13.869573 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba586a53-8749-426a-b98d-f302d902df37 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:13.869838 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba586a53-8749-426a-b98d-f302d902df37 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:13.870469 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba586a53-8749-426a-b98d-f302d902df37 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:13.871876 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba586a53-8749-426a-b98d-f302d902df37 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:13.873757 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:13.885196 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-ba586a53-8749-426a-b98d-f302d902df37 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 17:15:13.885196 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:15:13.885196 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 17:15:13.885196 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 17:15:13.885196 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 17:15:13.885196 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 17:15:13.885196 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 17:15:13.885196 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:15:13.885196 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 17:15:13.885196 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:15:13.885196 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:15:13.885196 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:15:13.885196 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:15:13.885196 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:15:13.885196 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:15:13.885196 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:15:13.885196 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:15:13.886304 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:15:13.886304 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:15:13.886304 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:15:13.886304 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:15:13.886304 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:15:13.886304 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:15:13.886304 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 17:15:13.886304 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 17:15:13.886304 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 17:15:13.886304 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 17:15:13.886304 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:15:13.886304 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:15:13.886304 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:15:13.886304 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:15:13.886304 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:15:13.886304 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:15:13.887167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:15:13.887167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:15:13.887167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:15:13.887167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:15:13.887167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:15:13.887167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:15:13.887167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:15:13.887167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:15:13.887167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:15:13.887167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:15:13.887167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 17:15:13.887167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:15:13.887167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 17:15:13.887167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:15:13.887167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 411/811] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:15:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:15:13.892706 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb82ef-1636-4d63-9455-6c2fa23e0a63 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:14.011336 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb82ef-1636-4d63-9455-6c2fa23e0a63 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:14.040070 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:14.049887 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82916057-69c5-476c-b1a1-8cda988f49ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:14.050550 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82916057-69c5-476c-b1a1-8cda988f49ed None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:14.050858 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82916057-69c5-476c-b1a1-8cda988f49ed None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:14.051131 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82916057-69c5-476c-b1a1-8cda988f49ed None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:14.051842 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82916057-69c5-476c-b1a1-8cda988f49ed None admin] RBAC: Adding query filter params (name=compute) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:15:14.052142 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82916057-69c5-476c-b1a1-8cda988f49ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:14.053529 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82916057-69c5-476c-b1a1-8cda988f49ed None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:14.058457 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 401/812] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 24 17:15:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:15:14.064458 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba586a53-8749-426a-b98d-f302d902df37 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:14.176435 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba586a53-8749-426a-b98d-f302d902df37 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:14.210121 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a44508-04f0-43fc-bfe0-f17f9b7bc1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:14.210797 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a44508-04f0-43fc-bfe0-f17f9b7bc1f7 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:14.211074 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a44508-04f0-43fc-bfe0-f17f9b7bc1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:14.211345 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a44508-04f0-43fc-bfe0-f17f9b7bc1f7 None admin] PATH_INFO: `/v3/services` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:14.212038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a44508-04f0-43fc-bfe0-f17f9b7bc1f7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:15:14.212342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a44508-04f0-43fc-bfe0-f17f9b7bc1f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:14.213719 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a44508-04f0-43fc-bfe0-f17f9b7bc1f7 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:14.218626 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 412/813] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 24 17:15:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:15:14.228526 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82916057-69c5-476c-b1a1-8cda988f49ed None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:14.347122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82916057-69c5-476c-b1a1-8cda988f49ed None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:14.387444 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7f4ed-0bbc-4f4d-9914-6a4c7f40c8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:14.388098 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7f4ed-0bbc-4f4d-9914-6a4c7f40c8b3 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:14.388376 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7f4ed-0bbc-4f4d-9914-6a4c7f40c8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:14.388648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7f4ed-0bbc-4f4d-9914-6a4c7f40c8b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:14.389430 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7f4ed-0bbc-4f4d-9914-6a4c7f40c8b3 None admin] RBAC: Adding query filter params (interface=public, service_id=568b760c569d4d1bbb6d92b38bb5dce2, region_id=RegionOne) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:15:14.389735 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7f4ed-0bbc-4f4d-9914-6a4c7f40c8b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:14.391168 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7f4ed-0bbc-4f4d-9914-6a4c7f40c8b3 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:14.396748 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 402/814] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Jun 24 17:15:14 2022] GET /identity/v3/endpoints?service_id=568b760c569d4d1bbb6d92b38bb5dce2&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:15:14.403134 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a44508-04f0-43fc-bfe0-f17f9b7bc1f7 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:14.473391 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:14.513151 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a44508-04f0-43fc-bfe0-f17f9b7bc1f7 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:14.551320 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc717e-932c-4894-9182-a7eb2a3a8abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:14.551963 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc717e-932c-4894-9182-a7eb2a3a8abf None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:14.552234 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc717e-932c-4894-9182-a7eb2a3a8abf None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:14.552505 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc717e-932c-4894-9182-a7eb2a3a8abf None admin] PATH_INFO: `/v3/services` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:14.553166 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc717e-932c-4894-9182-a7eb2a3a8abf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:14.554535 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc717e-932c-4894-9182-a7eb2a3a8abf None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:14.560878 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 413/815] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Jun 24 17:15:14 2022] GET /identity/v3/services => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 17:15:16.841121 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae85e81-8dbb-4354-b908-9245a81cd5ef None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:16.842012 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae85e81-8dbb-4354-b908-9245a81cd5ef None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:16.842012 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae85e81-8dbb-4354-b908-9245a81cd5ef None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:16.844173 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 403/816] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:15:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:15:16.850970 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fae584-42bb-41d5-9523-cbd0c2e08e62 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:16.851643 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fae584-42bb-41d5-9523-cbd0c2e08e62 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:16.851905 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fae584-42bb-41d5-9523-cbd0c2e08e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:16.873213 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-f5fae584-42bb-41d5-9523-cbd0c2e08e62 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:15:16.874392 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-f5fae584-42bb-41d5-9523-cbd0c2e08e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:15:16.965838 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 414/817] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:15:16 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:15:16.991411 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae85e81-8dbb-4354-b908-9245a81cd5ef None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:17.072737 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:17.121896 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae85e81-8dbb-4354-b908-9245a81cd5ef None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:17.167039 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b165131-b046-4d32-8092-0cc086a845fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:17.167831 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b165131-b046-4d32-8092-0cc086a845fa None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:17.168109 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b165131-b046-4d32-8092-0cc086a845fa None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:17.168379 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b165131-b046-4d32-8092-0cc086a845fa None admin] PATH_INFO: `/v3/services/compute` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:17.169033 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b165131-b046-4d32-8092-0cc086a845fa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:17.170429 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b165131-b046-4d32-8092-0cc086a845fa None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:17.182274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-4b165131-b046-4d32-8092-0cc086a845fa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 17:15:17.182274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:15:17.182274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 17:15:17.182274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 17:15:17.182274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 17:15:17.182274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 17:15:17.182274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 17:15:17.182274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:15:17.182274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 17:15:17.182274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:15:17.182274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:15:17.182274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:15:17.182274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:15:17.182274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:15:17.182274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:15:17.182274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:15:17.182274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:15:17.183364 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:15:17.183364 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:15:17.183364 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:15:17.183364 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:15:17.183364 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:15:17.183364 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:15:17.183364 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 17:15:17.183364 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 17:15:17.183364 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 17:15:17.183364 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 17:15:17.183364 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:15:17.183364 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:15:17.183364 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:15:17.183364 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:15:17.183364 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:15:17.183364 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:15:17.184358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:15:17.184358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:15:17.184358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:15:17.184358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:15:17.184358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:15:17.184358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:15:17.184358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:15:17.184358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:15:17.184358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:15:17.184358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:15:17.184358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 17:15:17.184358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:15:17.184358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 17:15:17.184358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:15:17.186715 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 404/818] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:15:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:15:17.189761 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fae584-42bb-41d5-9523-cbd0c2e08e62 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:17.249794 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:17.295064 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fae584-42bb-41d5-9523-cbd0c2e08e62 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:17.331214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30ba12-f5e4-4d07-bbf3-6812e7bc4461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:17.331859 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30ba12-f5e4-4d07-bbf3-6812e7bc4461 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:17.332108 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30ba12-f5e4-4d07-bbf3-6812e7bc4461 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:17.332401 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30ba12-f5e4-4d07-bbf3-6812e7bc4461 None admin] PATH_INFO: `/v3/services` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:17.333092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30ba12-f5e4-4d07-bbf3-6812e7bc4461 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:15:17.333386 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30ba12-f5e4-4d07-bbf3-6812e7bc4461 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:17.334776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30ba12-f5e4-4d07-bbf3-6812e7bc4461 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:17.339496 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 415/819] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 24 17:15:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:15:17.349022 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b165131-b046-4d32-8092-0cc086a845fa None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:17.478409 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b165131-b046-4d32-8092-0cc086a845fa None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:17.496048 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:17.516388 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e698b-88c5-4292-9c41-9ffe7354e82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:17.517050 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e698b-88c5-4292-9c41-9ffe7354e82f None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:17.517345 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e698b-88c5-4292-9c41-9ffe7354e82f None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:17.518182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e698b-88c5-4292-9c41-9ffe7354e82f None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:17.518949 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e698b-88c5-4292-9c41-9ffe7354e82f None admin] RBAC: Adding query filter params (type=compute) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:15:17.519260 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e698b-88c5-4292-9c41-9ffe7354e82f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:17.520666 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e698b-88c5-4292-9c41-9ffe7354e82f None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:17.525864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 405/820] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 24 17:15:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:15:17.531924 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30ba12-f5e4-4d07-bbf3-6812e7bc4461 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:15:17.645643 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30ba12-f5e4-4d07-bbf3-6812e7bc4461 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:15:17.666236 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:17.684441 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a72d35-0e00-428e-a15e-4060ce03d3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:15:17.685089 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a72d35-0e00-428e-a15e-4060ce03d3f5 None admin] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:15:17.685365 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a72d35-0e00-428e-a15e-4060ce03d3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:15:17.685634 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a72d35-0e00-428e-a15e-4060ce03d3f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:15:17.686382 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a72d35-0e00-428e-a15e-4060ce03d3f5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:15:17.687802 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a72d35-0e00-428e-a15e-4060ce03d3f5 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:15:17.710917 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 416/821] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Jun 24 17:15:17 2022] POST /identity/v3/endpoints => generated 334 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:15:27.523110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=9 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:15:27.706454 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=11,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:20.148299 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6b584-1148-49a1-97cb-d01fdf120d98 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:20.148922 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6b584-1148-49a1-97cb-d01fdf120d98 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:20.149039 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6b584-1148-49a1-97cb-d01fdf120d98 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:20.150513 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 406/822] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:16:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:16:20.156346 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128c067-0906-4830-99d0-d19f784bf87b None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:20.156928 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128c067-0906-4830-99d0-d19f784bf87b None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:20.156928 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128c067-0906-4830-99d0-d19f784bf87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:20.176478 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-0128c067-0906-4830-99d0-d19f784bf87b None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:16:20.177818 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-0128c067-0906-4830-99d0-d19f784bf87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:16:20.266768 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 417/823] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:16:20 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:16:20.296729 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6b584-1148-49a1-97cb-d01fdf120d98 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:20.427294 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6b584-1148-49a1-97cb-d01fdf120d98 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:20.462161 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecefebd-2674-4904-9c43-6601996c35d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:20.463003 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecefebd-2674-4904-9c43-6601996c35d2 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:20.463318 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecefebd-2674-4904-9c43-6601996c35d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:20.463534 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecefebd-2674-4904-9c43-6601996c35d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:20.476923 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecefebd-2674-4904-9c43-6601996c35d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:20.478431 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecefebd-2674-4904-9c43-6601996c35d2 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:20.496622 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-fecefebd-2674-4904-9c43-6601996c35d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:20.496622 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:20.496622 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:20.496622 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:20.496622 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:20.496622 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:20.496622 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:20.496622 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:20.496622 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:20.496622 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:20.496622 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:20.496622 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:20.496622 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:16:20.496622 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:16:20.496622 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:16:20.497985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:16:20.497985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:20.497985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:20.497985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:20.497985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:20.497985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:20.497985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:20.497985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:20.497985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:20.497985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:20.497985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:20.497985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:20.497985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:20.497985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:20.497985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:20.497985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:20.497985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:20.499316 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:16:20.499316 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:16:20.499316 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:20.499316 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:16:20.502786 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 407/824] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:16:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:20.504159 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128c067-0906-4830-99d0-d19f784bf87b None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:20.625224 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128c067-0906-4830-99d0-d19f784bf87b None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:20.664189 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:20.676390 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d6076-e69c-40b9-87e3-28d82f3c73d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:20.677132 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d6076-e69c-40b9-87e3-28d82f3c73d5 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:20.677476 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d6076-e69c-40b9-87e3-28d82f3c73d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:20.677771 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d6076-e69c-40b9-87e3-28d82f3c73d5 None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:20.678489 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d6076-e69c-40b9-87e3-28d82f3c73d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:20.678821 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d6076-e69c-40b9-87e3-28d82f3c73d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:20.680376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d6076-e69c-40b9-87e3-28d82f3c73d5 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:20.693755 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 418/825] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:20.699945 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecefebd-2674-4904-9c43-6601996c35d2 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:20.764642 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:20.827767 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecefebd-2674-4904-9c43-6601996c35d2 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:20.868406 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025ad8a-ca80-4f63-8e1d-cf9f0d080570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:20.869106 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025ad8a-ca80-4f63-8e1d-cf9f0d080570 None admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:20.869377 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025ad8a-ca80-4f63-8e1d-cf9f0d080570 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:20.869644 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025ad8a-ca80-4f63-8e1d-cf9f0d080570 None admin] PATH_INFO: `/v3/users` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:20.870356 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025ad8a-ca80-4f63-8e1d-cf9f0d080570 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:20.871881 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025ad8a-ca80-4f63-8e1d-cf9f0d080570 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:20.897120 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 408/826] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 24 17:16:20 2022] POST /identity/v3/users => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:16:23.414129 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6a372-343b-4fd6-b697-c53540703241 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:23.414728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6a372-343b-4fd6-b697-c53540703241 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:23.414728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6a372-343b-4fd6-b697-c53540703241 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:23.416247 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 419/827] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:16:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:16:23.421758 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d31b9c-d1ed-4f97-83b4-b521471913b2 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:23.422248 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d31b9c-d1ed-4f97-83b4-b521471913b2 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:23.422341 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d31b9c-d1ed-4f97-83b4-b521471913b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:23.439362 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-86d31b9c-d1ed-4f97-83b4-b521471913b2 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:16:23.440543 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-86d31b9c-d1ed-4f97-83b4-b521471913b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:16:23.515366 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 409/828] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:16:23 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:16:23.540784 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6a372-343b-4fd6-b697-c53540703241 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:23.656282 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6a372-343b-4fd6-b697-c53540703241 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:23.692336 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90a820-4576-41a4-adc5-16f90036b515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:23.693243 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90a820-4576-41a4-adc5-16f90036b515 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:23.693601 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90a820-4576-41a4-adc5-16f90036b515 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:23.693919 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90a820-4576-41a4-adc5-16f90036b515 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:23.707507 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90a820-4576-41a4-adc5-16f90036b515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:16:23.720073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-fe90a820-4576-41a4-adc5-16f90036b515 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:16:23.720073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:23.720073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:23.720073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:23.720073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:23.720073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:23.720073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:23.720073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:23.720073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:23.720073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:23.720073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:23.720073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:23.720073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:16:23.720073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:16:23.720073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:16:23.720073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:16:23.721088 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:16:23.721088 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:16:23.721088 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:16:23.721088 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:16:23.721088 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:23.721088 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:23.721088 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:23.721088 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:23.721088 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:23.721088 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:23.721088 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:23.721088 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:23.721088 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:23.721088 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:23.721088 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:23.721088 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:23.722156 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:23.722156 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:23.722156 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:23.722156 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:23.722156 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:16:23.722156 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:16:23.722156 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:16:23.722156 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:16:23.722156 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:16:23.722156 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:16:23.722156 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:16:23.722156 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:16:23.722156 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 420/829] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 24 17:16:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:23.728105 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d31b9c-d1ed-4f97-83b4-b521471913b2 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:23.772565 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:23.839804 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d31b9c-d1ed-4f97-83b4-b521471913b2 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:23.878140 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb559995-0d78-4d50-b1c9-4052ec8063bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:23.878880 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb559995-0d78-4d50-b1c9-4052ec8063bc None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:23.879157 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb559995-0d78-4d50-b1c9-4052ec8063bc None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:23.879432 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb559995-0d78-4d50-b1c9-4052ec8063bc None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:23.880172 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb559995-0d78-4d50-b1c9-4052ec8063bc None admin] RBAC: Adding query filter params (name=service) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:23.880476 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb559995-0d78-4d50-b1c9-4052ec8063bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:23.881869 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb559995-0d78-4d50-b1c9-4052ec8063bc None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:23.895223 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 410/830] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 24 17:16:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:23.896420 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90a820-4576-41a4-adc5-16f90036b515 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:23.949946 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:24.014519 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90a820-4576-41a4-adc5-16f90036b515 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:24.052432 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d6444-6220-40b3-bb92-db18ddde1510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:24.053221 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d6444-6220-40b3-bb92-db18ddde1510 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:24.053496 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d6444-6220-40b3-bb92-db18ddde1510 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:24.053778 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d6444-6220-40b3-bb92-db18ddde1510 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:24.064876 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d6444-6220-40b3-bb92-db18ddde1510 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:24.066345 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d6444-6220-40b3-bb92-db18ddde1510 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:24.086464 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-a50d6444-6220-40b3-bb92-db18ddde1510 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:24.086464 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:24.086464 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:24.086464 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:24.086464 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:24.086464 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:24.086464 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:24.086464 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:24.086464 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:24.086464 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:24.086464 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:24.086464 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:24.086464 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:16:24.086464 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:16:24.086464 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:16:24.087559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:16:24.087559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:24.087559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:24.087559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:24.087559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:24.087559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:24.087559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:24.087559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:24.087559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:24.087559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:24.087559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:24.087559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:24.087559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:24.087559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:24.087559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:24.087559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:24.087559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:24.088612 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:16:24.088612 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:16:24.088612 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:24.088612 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:16:24.088612 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 421/831] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:16:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:24.093819 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb559995-0d78-4d50-b1c9-4052ec8063bc None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:24.197411 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:24.201181 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb559995-0d78-4d50-b1c9-4052ec8063bc None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:24.236319 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a73f9-ef84-4d0e-8729-21277cc6ea6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:24.236999 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a73f9-ef84-4d0e-8729-21277cc6ea6a None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:24.237657 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a73f9-ef84-4d0e-8729-21277cc6ea6a None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:24.237657 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a73f9-ef84-4d0e-8729-21277cc6ea6a None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:24.238258 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a73f9-ef84-4d0e-8729-21277cc6ea6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:24.238554 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a73f9-ef84-4d0e-8729-21277cc6ea6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:24.239953 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a73f9-ef84-4d0e-8729-21277cc6ea6a None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:24.252542 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 411/832] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:24.258250 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d6444-6220-40b3-bb92-db18ddde1510 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:24.365738 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:24.370402 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d6444-6220-40b3-bb92-db18ddde1510 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:24.406938 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04801aef-d311-4bc6-865d-72234b3e00f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:24.407744 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04801aef-d311-4bc6-865d-72234b3e00f3 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:24.408020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04801aef-d311-4bc6-865d-72234b3e00f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:24.408294 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04801aef-d311-4bc6-865d-72234b3e00f3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:24.416342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04801aef-d311-4bc6-865d-72234b3e00f3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:24.418052 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04801aef-d311-4bc6-865d-72234b3e00f3 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:24.434695 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-04801aef-d311-4bc6-865d-72234b3e00f3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 17:16:24.434695 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:24.434695 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:24.434695 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:24.434695 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:24.434695 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:24.434695 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:24.434695 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:24.434695 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:24.434695 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:24.434695 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:24.434695 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:24.434695 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 17:16:24.434695 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 17:16:24.434695 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 17:16:24.434695 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 17:16:24.435882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:24.435882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:24.435882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 17:16:24.435882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:16:24.435882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 17:16:24.435882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:16:24.435882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:24.435882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:24.435882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:24.435882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:24.435882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:24.435882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:24.435882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:24.435882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:24.435882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:24.435882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:24.435882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:24.435882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:24.437150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:24.437150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:24.437150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 17:16:24.437150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 17:16:24.437150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 17:16:24.437150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 17:16:24.437150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 17:16:24.437150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 17:16:24.437150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 17:16:24.437150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:16:24.437150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 422/833] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:16:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:24.442532 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a73f9-ef84-4d0e-8729-21277cc6ea6a None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:24.560197 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a73f9-ef84-4d0e-8729-21277cc6ea6a None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:24.596921 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0b377-7d99-41a7-a140-612d360f1c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:24.597587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0b377-7d99-41a7-a140-612d360f1c2a None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:24.597855 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0b377-7d99-41a7-a140-612d360f1c2a None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:24.598124 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0b377-7d99-41a7-a140-612d360f1c2a None admin] PATH_INFO: `/v3/users` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:24.599085 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0b377-7d99-41a7-a140-612d360f1c2a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:24.599387 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0b377-7d99-41a7-a140-612d360f1c2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:24.600981 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0b377-7d99-41a7-a140-612d360f1c2a None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:24.620210 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 412/834] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Jun 24 17:16:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:24.627089 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04801aef-d311-4bc6-865d-72234b3e00f3 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:24.742105 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04801aef-d311-4bc6-865d-72234b3e00f3 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:24.784638 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67978db-9124-4800-88a3-b75fa8633ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:24.785534 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67978db-9124-4800-88a3-b75fa8633ab9 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:24.786016 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67978db-9124-4800-88a3-b75fa8633ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:24.786483 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67978db-9124-4800-88a3-b75fa8633ab9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:24.823952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:24.874050 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67978db-9124-4800-88a3-b75fa8633ab9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:24.875591 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67978db-9124-4800-88a3-b75fa8633ab9 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:24.982764 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 423/835] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:16:24 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 17:16:24.988948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0b377-7d99-41a7-a140-612d360f1c2a None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:25.010395 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:25.108932 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0b377-7d99-41a7-a140-612d360f1c2a None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:25.147227 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef640d5-340b-47a0-a7cd-71ebd327ef25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:25.148199 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef640d5-340b-47a0-a7cd-71ebd327ef25 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:25.148479 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef640d5-340b-47a0-a7cd-71ebd327ef25 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:25.148778 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef640d5-340b-47a0-a7cd-71ebd327ef25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:25.159844 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef640d5-340b-47a0-a7cd-71ebd327ef25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:25.161395 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef640d5-340b-47a0-a7cd-71ebd327ef25 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:25.179160 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-cef640d5-340b-47a0-a7cd-71ebd327ef25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:25.179160 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:25.179160 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:25.179160 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:25.179160 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:25.179160 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:25.179160 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:25.179160 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:25.179160 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:25.179160 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:25.179160 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:25.179160 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:25.179160 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:16:25.179160 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:16:25.179160 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:16:25.181021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:16:25.181021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:25.181021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:25.181021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:25.181021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:25.181021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:25.181021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:25.181021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:25.181021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:25.181021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:25.181021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:25.181021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:25.181021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:25.181021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:25.181021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:25.181021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:25.181021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:25.181973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:16:25.181973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:16:25.181973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:25.181973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:16:25.181973 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 413/836] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:25.186624 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67978db-9124-4800-88a3-b75fa8633ab9 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:25.251656 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:25.297845 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67978db-9124-4800-88a3-b75fa8633ab9 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:25.336058 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed7247-2cdf-4401-a030-47d2b4370e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:25.336946 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed7247-2cdf-4401-a030-47d2b4370e4e None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:25.337272 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed7247-2cdf-4401-a030-47d2b4370e4e None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:25.337549 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed7247-2cdf-4401-a030-47d2b4370e4e None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:25.338705 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed7247-2cdf-4401-a030-47d2b4370e4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:25.339237 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed7247-2cdf-4401-a030-47d2b4370e4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:25.342141 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed7247-2cdf-4401-a030-47d2b4370e4e None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:25.358835 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 424/837] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:25.364525 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef640d5-340b-47a0-a7cd-71ebd327ef25 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:25.443603 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:25.479154 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef640d5-340b-47a0-a7cd-71ebd327ef25 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:25.521804 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5757b-d6d4-420a-8bb3-3828152f6cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:25.522615 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5757b-d6d4-420a-8bb3-3828152f6cec None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:25.522902 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5757b-d6d4-420a-8bb3-3828152f6cec None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:25.523163 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5757b-d6d4-420a-8bb3-3828152f6cec None admin] PATH_INFO: `/v3/projects/service` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:25.532076 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5757b-d6d4-420a-8bb3-3828152f6cec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:25.533779 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5757b-d6d4-420a-8bb3-3828152f6cec None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:25.548204 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-46a5757b-d6d4-420a-8bb3-3828152f6cec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:16:25.548204 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:25.548204 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:25.548204 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:25.548204 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:25.548204 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:25.548204 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:25.548204 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:25.548204 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:25.548204 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:25.548204 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:25.548204 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:25.548204 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 17:16:25.548204 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 17:16:25.548204 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 17:16:25.549412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 17:16:25.549412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:25.549412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:25.549412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:25.549412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:25.549412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:25.549412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:25.549412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:25.549412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:25.549412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:25.549412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:25.549412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:25.549412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:25.549412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:25.549412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:25.549412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:25.549412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:25.550633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 17:16:25.550633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 17:16:25.550633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 17:16:25.550633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 17:16:25.550633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 17:16:25.550633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 17:16:25.550633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:16:25.550633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:16:25.550633 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 414/838] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:16:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:25.555542 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed7247-2cdf-4401-a030-47d2b4370e4e None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:25.659460 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed7247-2cdf-4401-a030-47d2b4370e4e None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:25.677491 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:25.695127 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcb8fa-49b7-4575-bbe0-70f4c2a9083e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:25.695918 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcb8fa-49b7-4575-bbe0-70f4c2a9083e None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:25.696281 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcb8fa-49b7-4575-bbe0-70f4c2a9083e None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:25.696557 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcb8fa-49b7-4575-bbe0-70f4c2a9083e None admin] PATH_INFO: `/v3/projects` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:25.697435 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcb8fa-49b7-4575-bbe0-70f4c2a9083e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:25.697709 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcb8fa-49b7-4575-bbe0-70f4c2a9083e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:25.699167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcb8fa-49b7-4575-bbe0-70f4c2a9083e None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:25.712259 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 425/839] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 24 17:16:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:25.719283 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5757b-d6d4-420a-8bb3-3828152f6cec None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:25.817366 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5757b-d6d4-420a-8bb3-3828152f6cec None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:25.847273 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:25.853052 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ec00a-12b0-42b6-a1cb-491d4ead92bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:25.853708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ec00a-12b0-42b6-a1cb-491d4ead92bd None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:25.854006 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ec00a-12b0-42b6-a1cb-491d4ead92bd None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:25.854258 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ec00a-12b0-42b6-a1cb-491d4ead92bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:25.855469 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ec00a-12b0-42b6-a1cb-491d4ead92bd None admin] RBAC: Adding query filter params (role.id=a10baa216e4941ad8d168a1f7825a966, scope.project.id=fb66039441c14b96a79a30de4a833fa2, user.id=b318b7cfb1c5485cba96997ddd73945c) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:25.855766 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ec00a-12b0-42b6-a1cb-491d4ead92bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:25.857791 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ec00a-12b0-42b6-a1cb-491d4ead92bd None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:25.863546 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 415/840] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:16:25 2022] GET /identity/v3/role_assignments?user.id=b318b7cfb1c5485cba96997ddd73945c&scope.project.id=fb66039441c14b96a79a30de4a833fa2&role.id=a10baa216e4941ad8d168a1f7825a966 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:28.312241 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cdf99-2329-4348-bae5-e131ea0e0958 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:28.312782 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cdf99-2329-4348-bae5-e131ea0e0958 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:28.312782 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cdf99-2329-4348-bae5-e131ea0e0958 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:28.315001 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 426/841] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:16:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:16:28.322319 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b320f9-5d9a-4562-811c-d25ac2e4dedd None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:28.322809 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b320f9-5d9a-4562-811c-d25ac2e4dedd None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:28.322912 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b320f9-5d9a-4562-811c-d25ac2e4dedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:28.346312 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-d4b320f9-5d9a-4562-811c-d25ac2e4dedd None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:16:28.347690 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-d4b320f9-5d9a-4562-811c-d25ac2e4dedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:16:28.424025 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 416/842] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:16:28 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:16:28.451788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cdf99-2329-4348-bae5-e131ea0e0958 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:28.570607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cdf99-2329-4348-bae5-e131ea0e0958 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:28.608764 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acd84b-05d4-4697-851e-123798ad3f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:28.609608 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acd84b-05d4-4697-851e-123798ad3f8b None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:28.609865 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acd84b-05d4-4697-851e-123798ad3f8b None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:28.610179 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acd84b-05d4-4697-851e-123798ad3f8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:28.621248 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27acd84b-05d4-4697-851e-123798ad3f8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:16:28.629332 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-27acd84b-05d4-4697-851e-123798ad3f8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:16:28.629332 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:28.629332 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:28.629332 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:28.629332 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:28.629332 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:28.629332 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:28.629332 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:28.629332 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:28.629332 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:28.629332 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:28.629332 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:28.629332 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:16:28.629332 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:16:28.629332 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:16:28.629332 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:16:28.630520 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:16:28.630520 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:16:28.630520 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:16:28.630520 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:16:28.630520 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:28.630520 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:28.630520 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:28.630520 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:28.630520 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:28.630520 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:28.630520 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:28.630520 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:28.630520 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:28.630520 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:28.630520 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:28.630520 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:28.631506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:28.631506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:28.631506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:28.631506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:28.631506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:16:28.631506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:16:28.631506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:16:28.631506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:16:28.631506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:16:28.631506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:16:28.631506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:16:28.631506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:16:28.631506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 427/843] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 24 17:16:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:28.636751 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b320f9-5d9a-4562-811c-d25ac2e4dedd None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:28.741666 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b320f9-5d9a-4562-811c-d25ac2e4dedd None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:28.766312 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:28.778930 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237b93a-6778-4cb8-bbd4-f4725322cef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:28.779810 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237b93a-6778-4cb8-bbd4-f4725322cef3 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:28.780172 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237b93a-6778-4cb8-bbd4-f4725322cef3 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:28.780622 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237b93a-6778-4cb8-bbd4-f4725322cef3 None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:28.781496 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237b93a-6778-4cb8-bbd4-f4725322cef3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:28.781916 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237b93a-6778-4cb8-bbd4-f4725322cef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:28.783447 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237b93a-6778-4cb8-bbd4-f4725322cef3 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:28.792559 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 417/844] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 24 17:16:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:28.798734 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acd84b-05d4-4697-851e-123798ad3f8b None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:28.843352 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:28.908577 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acd84b-05d4-4697-851e-123798ad3f8b None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:28.944982 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2f908-828f-4af6-af30-4a937fd45e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:28.945804 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2f908-828f-4af6-af30-4a937fd45e7c None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:28.946079 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2f908-828f-4af6-af30-4a937fd45e7c None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:28.946347 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2f908-828f-4af6-af30-4a937fd45e7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:28.956628 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2f908-828f-4af6-af30-4a937fd45e7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:28.958096 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2f908-828f-4af6-af30-4a937fd45e7c None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:28.976713 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-51a2f908-828f-4af6-af30-4a937fd45e7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:28.976713 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:28.976713 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:28.976713 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:28.976713 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:28.976713 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:28.976713 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:28.976713 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:28.976713 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:28.976713 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:28.976713 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:28.976713 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:28.976713 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:16:28.976713 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:16:28.976713 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:16:28.977776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:16:28.977776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:28.977776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:28.977776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:28.977776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:28.977776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:28.977776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:28.977776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:28.977776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:28.977776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:28.977776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:28.977776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:28.977776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:28.977776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:28.977776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:28.977776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:28.977776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:28.978930 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:16:28.978930 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:16:28.978930 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:28.978930 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:16:28.978930 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 428/845] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:28.985466 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237b93a-6778-4cb8-bbd4-f4725322cef3 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:29.102556 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237b93a-6778-4cb8-bbd4-f4725322cef3 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:29.141980 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6419ea-3a3d-468f-b735-e11f105e7bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:29.142681 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6419ea-3a3d-468f-b735-e11f105e7bf6 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:29.142960 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6419ea-3a3d-468f-b735-e11f105e7bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:29.143231 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6419ea-3a3d-468f-b735-e11f105e7bf6 None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:29.143940 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6419ea-3a3d-468f-b735-e11f105e7bf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:29.144238 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6419ea-3a3d-468f-b735-e11f105e7bf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:29.145602 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6419ea-3a3d-468f-b735-e11f105e7bf6 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:29.158040 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 418/846] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:29.164395 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2f908-828f-4af6-af30-4a937fd45e7c None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:29.266098 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:29.277845 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2f908-828f-4af6-af30-4a937fd45e7c None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:29.315828 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726773b9-4b10-4515-b4cd-bf0cac58acb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:29.316796 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726773b9-4b10-4515-b4cd-bf0cac58acb5 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:29.317072 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726773b9-4b10-4515-b4cd-bf0cac58acb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:29.317470 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726773b9-4b10-4515-b4cd-bf0cac58acb5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:29.325569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726773b9-4b10-4515-b4cd-bf0cac58acb5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:29.327313 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726773b9-4b10-4515-b4cd-bf0cac58acb5 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:29.344569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-726773b9-4b10-4515-b4cd-bf0cac58acb5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 17:16:29.344569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:29.344569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:29.344569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:29.344569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:29.344569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:29.344569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:29.344569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:29.344569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:29.344569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:29.344569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:29.344569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:29.344569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 17:16:29.344569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 17:16:29.344569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 17:16:29.344569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 17:16:29.345582 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:29.345582 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:29.345582 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 17:16:29.345582 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:16:29.345582 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 17:16:29.345582 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:16:29.345582 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:29.345582 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:29.345582 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:29.345582 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:29.345582 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:29.345582 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:29.345582 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:29.345582 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:29.345582 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:29.345582 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:29.345582 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:29.345582 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:29.346516 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:29.346516 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:29.346516 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 17:16:29.346516 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 17:16:29.346516 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 17:16:29.346516 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 17:16:29.346516 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 17:16:29.346516 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 17:16:29.346516 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 17:16:29.346516 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:16:29.346516 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 429/847] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:16:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:16:29.352889 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6419ea-3a3d-468f-b735-e11f105e7bf6 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:29.404907 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:29.461670 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6419ea-3a3d-468f-b735-e11f105e7bf6 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:29.496835 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245f5c2-de7b-435c-a728-6fcfc00e6a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:29.497778 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245f5c2-de7b-435c-a728-6fcfc00e6a07 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:29.498061 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245f5c2-de7b-435c-a728-6fcfc00e6a07 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:29.498330 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245f5c2-de7b-435c-a728-6fcfc00e6a07 None admin] PATH_INFO: `/v3/users` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:29.499204 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245f5c2-de7b-435c-a728-6fcfc00e6a07 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:29.499509 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245f5c2-de7b-435c-a728-6fcfc00e6a07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:29.500964 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245f5c2-de7b-435c-a728-6fcfc00e6a07 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:29.528229 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 419/848] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Jun 24 17:16:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:29.530123 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726773b9-4b10-4515-b4cd-bf0cac58acb5 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:29.641881 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726773b9-4b10-4515-b4cd-bf0cac58acb5 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:29.678340 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592117bd-3b29-4c43-9c63-99ff5962b62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:29.679292 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592117bd-3b29-4c43-9c63-99ff5962b62b None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:29.679666 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592117bd-3b29-4c43-9c63-99ff5962b62b None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:29.679901 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592117bd-3b29-4c43-9c63-99ff5962b62b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:29.692664 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592117bd-3b29-4c43-9c63-99ff5962b62b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:29.694310 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592117bd-3b29-4c43-9c63-99ff5962b62b None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:29.714000 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-592117bd-3b29-4c43-9c63-99ff5962b62b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:29.714000 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:29.714000 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:29.714000 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:29.714000 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:29.714000 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:29.714000 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:29.714000 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:29.714000 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:29.714000 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:29.714000 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:29.714000 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:29.714000 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:16:29.714000 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:16:29.714000 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:16:29.714966 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:16:29.714966 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:29.714966 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:29.714966 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:29.714966 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:29.714966 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:29.714966 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:29.714966 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:29.714966 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:29.714966 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:29.714966 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:29.714966 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:29.714966 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:29.714966 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:29.714966 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:29.714966 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:29.714966 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:29.716175 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:16:29.716175 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:16:29.716175 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:29.716175 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:16:29.716175 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 430/849] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:16:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:16:29.721870 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245f5c2-de7b-435c-a728-6fcfc00e6a07 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:29.823900 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245f5c2-de7b-435c-a728-6fcfc00e6a07 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:29.827189 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:29.862817 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36be07-e6c5-43ab-91df-c1ccffdc5782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:29.863581 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36be07-e6c5-43ab-91df-c1ccffdc5782 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:29.863883 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36be07-e6c5-43ab-91df-c1ccffdc5782 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:29.864191 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36be07-e6c5-43ab-91df-c1ccffdc5782 None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:29.864954 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36be07-e6c5-43ab-91df-c1ccffdc5782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:29.865255 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36be07-e6c5-43ab-91df-c1ccffdc5782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:29.866796 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36be07-e6c5-43ab-91df-c1ccffdc5782 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:29.879788 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 420/850] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:29.886021 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592117bd-3b29-4c43-9c63-99ff5962b62b None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:29.889678 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:30.002268 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592117bd-3b29-4c43-9c63-99ff5962b62b None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:30.041759 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29132a-3362-4257-a3e8-109549ecb482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:30.043952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29132a-3362-4257-a3e8-109549ecb482 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:30.043952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29132a-3362-4257-a3e8-109549ecb482 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:30.043952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29132a-3362-4257-a3e8-109549ecb482 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:30.050754 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29132a-3362-4257-a3e8-109549ecb482 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:30.052197 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29132a-3362-4257-a3e8-109549ecb482 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:30.067594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-ec29132a-3362-4257-a3e8-109549ecb482 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:16:30.067594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:30.067594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:30.067594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:30.067594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:30.067594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:30.067594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:30.067594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:30.067594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:30.067594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:30.067594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:30.067594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:30.067594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 17:16:30.067594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 17:16:30.067594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 17:16:30.068552 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 17:16:30.068552 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:30.068552 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:30.068552 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:30.068552 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:30.068552 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:30.068552 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:30.068552 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:30.068552 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:30.068552 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:30.068552 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:30.068552 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:30.068552 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:30.068552 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:30.068552 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:30.068552 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:30.068552 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:30.069466 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 17:16:30.069466 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 17:16:30.069466 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 17:16:30.069466 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 17:16:30.069466 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 17:16:30.069466 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 17:16:30.069466 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:16:30.069466 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:16:30.069466 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 431/851] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:16:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:30.074906 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36be07-e6c5-43ab-91df-c1ccffdc5782 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:30.191088 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36be07-e6c5-43ab-91df-c1ccffdc5782 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:30.227594 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ab3d7-a9b2-492c-9ab8-72d7f79eec2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:30.228260 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ab3d7-a9b2-492c-9ab8-72d7f79eec2f None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:30.228543 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ab3d7-a9b2-492c-9ab8-72d7f79eec2f None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:30.228816 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ab3d7-a9b2-492c-9ab8-72d7f79eec2f None admin] PATH_INFO: `/v3/projects` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:30.229604 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ab3d7-a9b2-492c-9ab8-72d7f79eec2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:30.229913 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ab3d7-a9b2-492c-9ab8-72d7f79eec2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:30.231508 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ab3d7-a9b2-492c-9ab8-72d7f79eec2f None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:30.246957 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 421/852] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 24 17:16:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:30.253428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29132a-3362-4257-a3e8-109549ecb482 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:30.323267 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:30.364963 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29132a-3362-4257-a3e8-109549ecb482 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:30.405717 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076937c-eb7c-40bb-9f62-c7d9a59f1422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:30.406680 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076937c-eb7c-40bb-9f62-c7d9a59f1422 None admin] REQUEST_METHOD: `PUT` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:30.406915 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076937c-eb7c-40bb-9f62-c7d9a59f1422 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:30.407204 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076937c-eb7c-40bb-9f62-c7d9a59f1422 None admin] PATH_INFO: `/v3/projects/fb66039441c14b96a79a30de4a833fa2/users/b318b7cfb1c5485cba96997ddd73945c/roles/a10baa216e4941ad8d168a1f7825a966` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:30.424556 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076937c-eb7c-40bb-9f62-c7d9a59f1422 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb66039441c14b96a79a30de4a833fa2, user_id=b318b7cfb1c5485cba96997ddd73945c, role_id=a10baa216e4941ad8d168a1f7825a966)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:30.426030 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076937c-eb7c-40bb-9f62-c7d9a59f1422 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:30.441545 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 432/853] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 24 17:16:30 2022] PUT /identity/v3/projects/fb66039441c14b96a79a30de4a833fa2/users/b318b7cfb1c5485cba96997ddd73945c/roles/a10baa216e4941ad8d168a1f7825a966 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:16:32.823790 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79e4c1-3897-4e74-b73d-08b39d882a85 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:32.824371 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79e4c1-3897-4e74-b73d-08b39d882a85 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:32.824371 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79e4c1-3897-4e74-b73d-08b39d882a85 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:32.825712 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 422/854] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:16:32.831491 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d602c-2a35-44b3-bcda-33f8b90e6e19 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:32.831998 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d602c-2a35-44b3-bcda-33f8b90e6e19 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:32.832092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d602c-2a35-44b3-bcda-33f8b90e6e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:32.850488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-113d602c-2a35-44b3-bcda-33f8b90e6e19 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:16:32.851757 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-113d602c-2a35-44b3-bcda-33f8b90e6e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:16:32.921498 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 433/855] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:16:32 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:16:32.946166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79e4c1-3897-4e74-b73d-08b39d882a85 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:32.978537 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:33.070124 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79e4c1-3897-4e74-b73d-08b39d882a85 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:33.109307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d74a07-6b77-4203-8f7f-c807671f11cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:33.110756 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d74a07-6b77-4203-8f7f-c807671f11cf None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:33.110888 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d74a07-6b77-4203-8f7f-c807671f11cf None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:33.111153 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d74a07-6b77-4203-8f7f-c807671f11cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:33.123964 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d74a07-6b77-4203-8f7f-c807671f11cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:16:33.132488 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-e4d74a07-6b77-4203-8f7f-c807671f11cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:16:33.132488 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:33.132488 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:33.132488 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:33.132488 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:33.132488 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:33.132488 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:33.132488 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:33.132488 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:33.132488 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:33.132488 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:33.132488 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:33.132488 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:16:33.132488 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:16:33.132488 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:16:33.132488 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:16:33.133451 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:16:33.133451 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:16:33.133451 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:16:33.133451 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:16:33.133451 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:33.133451 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:33.133451 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:33.133451 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:33.133451 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:33.133451 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:33.133451 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:33.133451 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:33.133451 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:33.133451 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:33.133451 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:33.133451 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:33.134347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:33.134347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:33.134347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:33.134347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:33.134347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:16:33.134347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:16:33.134347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:16:33.134347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:16:33.134347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:16:33.134347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:16:33.134347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 17:16:33.134347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:16:33.134347 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 423/856] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 24 17:16:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:33.140497 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d602c-2a35-44b3-bcda-33f8b90e6e19 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:33.185931 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:33.248747 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d602c-2a35-44b3-bcda-33f8b90e6e19 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:33.286902 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3e274-7fa1-40ae-836c-d4d748c135f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:33.287751 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3e274-7fa1-40ae-836c-d4d748c135f5 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:33.288064 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3e274-7fa1-40ae-836c-d4d748c135f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:33.288391 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3e274-7fa1-40ae-836c-d4d748c135f5 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:33.289727 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3e274-7fa1-40ae-836c-d4d748c135f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:33.290042 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3e274-7fa1-40ae-836c-d4d748c135f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:33.291648 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3e274-7fa1-40ae-836c-d4d748c135f5 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:33.305201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 434/857] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 24 17:16:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:33.306498 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d74a07-6b77-4203-8f7f-c807671f11cf None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:33.396643 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:33.415305 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d74a07-6b77-4203-8f7f-c807671f11cf None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:33.453646 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c7580-5fb9-455a-9154-4a4e47d60bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:33.454745 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c7580-5fb9-455a-9154-4a4e47d60bb8 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:33.455024 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c7580-5fb9-455a-9154-4a4e47d60bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:33.455284 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c7580-5fb9-455a-9154-4a4e47d60bb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:33.467730 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c7580-5fb9-455a-9154-4a4e47d60bb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:33.469775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c7580-5fb9-455a-9154-4a4e47d60bb8 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:33.486921 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-e69c7580-5fb9-455a-9154-4a4e47d60bb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:33.486921 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:33.486921 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:33.486921 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:33.486921 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:33.486921 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:33.486921 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:33.486921 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:33.486921 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:33.486921 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:33.486921 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:33.486921 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:33.486921 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:16:33.486921 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:16:33.486921 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:16:33.488011 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:16:33.488011 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:33.488011 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:33.488011 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:33.488011 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:33.488011 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:33.488011 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:33.488011 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:33.488011 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:33.488011 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:33.488011 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:33.488011 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:33.488011 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:33.488011 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:33.488011 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:33.488011 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:33.488011 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:33.493968 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:16:33.493968 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:16:33.493968 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:33.493968 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:16:33.493968 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 424/858] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:33.494324 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3e274-7fa1-40ae-836c-d4d748c135f5 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:33.605160 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3e274-7fa1-40ae-836c-d4d748c135f5 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:33.608033 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:33.644346 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b6afa-cf6d-4ac7-8346-b225c7e75bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:33.645019 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b6afa-cf6d-4ac7-8346-b225c7e75bab None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:33.645303 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b6afa-cf6d-4ac7-8346-b225c7e75bab None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:33.645571 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b6afa-cf6d-4ac7-8346-b225c7e75bab None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:33.646298 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b6afa-cf6d-4ac7-8346-b225c7e75bab None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:33.646630 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b6afa-cf6d-4ac7-8346-b225c7e75bab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:33.648169 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b6afa-cf6d-4ac7-8346-b225c7e75bab None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:33.661234 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 435/859] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:16:33.667460 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c7580-5fb9-455a-9154-4a4e47d60bb8 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:33.789934 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c7580-5fb9-455a-9154-4a4e47d60bb8 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:33.828375 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad6cee-c0aa-43c6-96a0-2656b6a7a36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:33.829308 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad6cee-c0aa-43c6-96a0-2656b6a7a36e None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:33.829588 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad6cee-c0aa-43c6-96a0-2656b6a7a36e None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:33.829864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad6cee-c0aa-43c6-96a0-2656b6a7a36e None admin] PATH_INFO: `/v3/users/placement` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:33.833206 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:33.838938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad6cee-c0aa-43c6-96a0-2656b6a7a36e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:33.840410 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad6cee-c0aa-43c6-96a0-2656b6a7a36e None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:33.856133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-69ad6cee-c0aa-43c6-96a0-2656b6a7a36e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 17:16:33.856133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:33.856133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:33.856133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:33.856133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:33.856133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:33.856133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:33.856133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:33.856133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:33.856133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:33.856133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:33.856133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:33.856133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 17:16:33.856133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 17:16:33.856133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 17:16:33.856133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 17:16:33.857397 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:33.857397 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:33.857397 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 17:16:33.857397 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:16:33.857397 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 17:16:33.857397 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:16:33.857397 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:33.857397 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:33.857397 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:33.857397 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:33.857397 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:33.857397 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:33.857397 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:33.857397 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:33.857397 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:33.857397 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:33.857397 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:33.857397 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:33.858634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:33.858634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:33.858634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 17:16:33.858634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 17:16:33.858634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 17:16:33.858634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 17:16:33.858634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 17:16:33.858634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 17:16:33.858634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 17:16:33.858634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:16:33.858634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 425/860] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:16:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:33.863716 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b6afa-cf6d-4ac7-8346-b225c7e75bab None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:33.992167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b6afa-cf6d-4ac7-8346-b225c7e75bab None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:34.032024 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e65415-9cfc-4136-bc10-3364ac636e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:34.032746 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e65415-9cfc-4136-bc10-3364ac636e44 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:34.033087 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e65415-9cfc-4136-bc10-3364ac636e44 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:34.033372 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e65415-9cfc-4136-bc10-3364ac636e44 None admin] PATH_INFO: `/v3/users` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:34.034425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e65415-9cfc-4136-bc10-3364ac636e44 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:34.036762 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e65415-9cfc-4136-bc10-3364ac636e44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:34.038261 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e65415-9cfc-4136-bc10-3364ac636e44 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:34.060688 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 436/861] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Jun 24 17:16:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:34.067711 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad6cee-c0aa-43c6-96a0-2656b6a7a36e None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:34.176241 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad6cee-c0aa-43c6-96a0-2656b6a7a36e None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:34.213477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f444ef1-3038-4460-a56c-6571ab302352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:34.214131 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f444ef1-3038-4460-a56c-6571ab302352 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:34.214406 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f444ef1-3038-4460-a56c-6571ab302352 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:34.214714 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f444ef1-3038-4460-a56c-6571ab302352 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:34.289716 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:34.299190 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f444ef1-3038-4460-a56c-6571ab302352 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:34.301138 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f444ef1-3038-4460-a56c-6571ab302352 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:34.417596 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 426/862] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:16:34 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 17:16:34.424186 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e65415-9cfc-4136-bc10-3364ac636e44 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:34.452399 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:34.540783 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e65415-9cfc-4136-bc10-3364ac636e44 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:34.582105 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf7358-99e6-44ab-b7e1-ff30dca4946b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:34.583023 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf7358-99e6-44ab-b7e1-ff30dca4946b None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:34.583315 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf7358-99e6-44ab-b7e1-ff30dca4946b None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:34.583629 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf7358-99e6-44ab-b7e1-ff30dca4946b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:34.594709 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf7358-99e6-44ab-b7e1-ff30dca4946b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:34.596432 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf7358-99e6-44ab-b7e1-ff30dca4946b None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:34.616172 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-8abf7358-99e6-44ab-b7e1-ff30dca4946b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:34.616172 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:34.616172 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:34.616172 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:34.616172 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:34.616172 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:34.616172 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:34.616172 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:34.616172 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:34.616172 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:34.616172 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:34.616172 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:34.616172 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:16:34.616172 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:16:34.616172 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:16:34.617428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:16:34.617428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:34.617428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:34.617428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:34.617428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:34.617428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:34.617428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:34.617428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:34.617428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:34.617428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:34.617428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:34.617428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:34.617428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:34.617428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:34.617428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:34.617428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:34.617428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:34.618674 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:16:34.618674 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:16:34.618674 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:34.618674 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:16:34.619592 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 437/863] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:34.626012 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f444ef1-3038-4460-a56c-6571ab302352 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:34.737878 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:34.744546 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f444ef1-3038-4460-a56c-6571ab302352 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:34.781755 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfabaf4-1d16-43ab-963a-7e449c339cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:34.782756 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfabaf4-1d16-43ab-963a-7e449c339cd4 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:34.782756 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfabaf4-1d16-43ab-963a-7e449c339cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:34.783042 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfabaf4-1d16-43ab-963a-7e449c339cd4 None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:34.783752 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfabaf4-1d16-43ab-963a-7e449c339cd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:34.784054 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfabaf4-1d16-43ab-963a-7e449c339cd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:34.785458 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfabaf4-1d16-43ab-963a-7e449c339cd4 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:34.796832 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 427/864] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:34.803020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf7358-99e6-44ab-b7e1-ff30dca4946b None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:34.883427 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:34.911359 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf7358-99e6-44ab-b7e1-ff30dca4946b None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:34.948759 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a497b9c-a75e-413e-b34c-a7b279040e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:34.949559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a497b9c-a75e-413e-b34c-a7b279040e21 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:34.949829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a497b9c-a75e-413e-b34c-a7b279040e21 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:34.950107 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a497b9c-a75e-413e-b34c-a7b279040e21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:34.957125 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a497b9c-a75e-413e-b34c-a7b279040e21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:34.958592 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a497b9c-a75e-413e-b34c-a7b279040e21 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:34.973994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-0a497b9c-a75e-413e-b34c-a7b279040e21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:16:34.973994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:34.973994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:34.973994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:34.973994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:34.973994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:34.973994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:34.973994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:34.973994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:34.973994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:34.973994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:34.973994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:34.973994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 17:16:34.973994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 17:16:34.973994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 17:16:34.975022 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 17:16:34.975022 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:34.975022 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:34.975022 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:34.975022 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:34.975022 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:34.975022 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:34.975022 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:34.975022 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:34.975022 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:34.975022 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:34.975022 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:34.975022 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:34.975022 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:34.975022 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:34.975022 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:34.975022 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:34.975934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 17:16:34.975934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 17:16:34.975934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 17:16:34.975934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 17:16:34.975934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 17:16:34.975934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 17:16:34.975934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:16:34.975934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:16:34.975934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 438/865] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:16:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:34.981169 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfabaf4-1d16-43ab-963a-7e449c339cd4 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:35.096788 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfabaf4-1d16-43ab-963a-7e449c339cd4 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:35.143512 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50e039-8b0c-4c8a-bd7b-d4c0cad5721a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:35.148374 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50e039-8b0c-4c8a-bd7b-d4c0cad5721a None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:35.148374 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50e039-8b0c-4c8a-bd7b-d4c0cad5721a None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:35.148374 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50e039-8b0c-4c8a-bd7b-d4c0cad5721a None admin] PATH_INFO: `/v3/projects` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:35.148374 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50e039-8b0c-4c8a-bd7b-d4c0cad5721a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:35.148374 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50e039-8b0c-4c8a-bd7b-d4c0cad5721a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:35.148374 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50e039-8b0c-4c8a-bd7b-d4c0cad5721a None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:35.162915 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 428/866] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 24 17:16:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:35.169005 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a497b9c-a75e-413e-b34c-a7b279040e21 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:35.278613 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a497b9c-a75e-413e-b34c-a7b279040e21 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:35.321459 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56265b7f-a99d-4a28-860d-6ad65f75f7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:35.322102 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56265b7f-a99d-4a28-860d-6ad65f75f7e0 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:35.322422 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56265b7f-a99d-4a28-860d-6ad65f75f7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:35.322695 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56265b7f-a99d-4a28-860d-6ad65f75f7e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:35.323558 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56265b7f-a99d-4a28-860d-6ad65f75f7e0 None admin] RBAC: Adding query filter params (role.id=a10baa216e4941ad8d168a1f7825a966, scope.project.id=fb66039441c14b96a79a30de4a833fa2, user.id=b318b7cfb1c5485cba96997ddd73945c) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:35.323875 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56265b7f-a99d-4a28-860d-6ad65f75f7e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:35.325355 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56265b7f-a99d-4a28-860d-6ad65f75f7e0 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:35.327319 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:35.338880 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 439/867] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:16:35 2022] GET /identity/v3/role_assignments?user.id=b318b7cfb1c5485cba96997ddd73945c&scope.project.id=fb66039441c14b96a79a30de4a833fa2&role.id=a10baa216e4941ad8d168a1f7825a966 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:16:37.743995 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722d0a4-e479-45bd-9624-819100c0d1cf None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:37.744580 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722d0a4-e479-45bd-9624-819100c0d1cf None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:37.744580 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722d0a4-e479-45bd-9624-819100c0d1cf None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:37.745962 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 429/868] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:16:37.752013 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef8be7-bbb8-4e2c-b08c-9cc7a404ade7 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:37.752617 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef8be7-bbb8-4e2c-b08c-9cc7a404ade7 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:37.752617 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef8be7-bbb8-4e2c-b08c-9cc7a404ade7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:37.770609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-c0ef8be7-bbb8-4e2c-b08c-9cc7a404ade7 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:16:37.772095 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-c0ef8be7-bbb8-4e2c-b08c-9cc7a404ade7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:16:37.851136 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 440/869] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:16:37 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:16:37.875950 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722d0a4-e479-45bd-9624-819100c0d1cf None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:37.896435 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:37.985502 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722d0a4-e479-45bd-9624-819100c0d1cf None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:38.035643 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ec593-d455-440c-a3c3-ec3b97a20c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:38.036481 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ec593-d455-440c-a3c3-ec3b97a20c56 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:38.036756 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ec593-d455-440c-a3c3-ec3b97a20c56 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:38.037036 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ec593-d455-440c-a3c3-ec3b97a20c56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:38.048705 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ec593-d455-440c-a3c3-ec3b97a20c56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:16:38.056678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-7d1ec593-d455-440c-a3c3-ec3b97a20c56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:16:38.056678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:38.056678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:38.056678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:38.056678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:38.056678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:38.056678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:38.056678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:38.056678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:38.056678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:38.056678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:38.056678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:38.056678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:16:38.056678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:16:38.056678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:16:38.056678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:16:38.057853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:16:38.057853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:16:38.057853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:16:38.057853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:16:38.057853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:38.057853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:38.057853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:38.057853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:38.057853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:38.057853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:38.057853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:38.057853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:38.057853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:38.057853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:38.057853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:38.057853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:38.058797 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:38.058797 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:38.058797 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:38.058797 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:38.058797 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:16:38.058797 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:16:38.058797 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:16:38.058797 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:16:38.058797 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:16:38.058797 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:16:38.058797 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:16:38.058797 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:16:38.058797 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 430/870] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 24 17:16:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:38.065548 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef8be7-bbb8-4e2c-b08c-9cc7a404ade7 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:38.173685 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef8be7-bbb8-4e2c-b08c-9cc7a404ade7 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:38.201375 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:38.209853 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d716283-0704-4ec4-9816-079c2bedb376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:38.210527 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d716283-0704-4ec4-9816-079c2bedb376 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:38.210870 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d716283-0704-4ec4-9816-079c2bedb376 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:38.211157 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d716283-0704-4ec4-9816-079c2bedb376 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:38.211875 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d716283-0704-4ec4-9816-079c2bedb376 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:38.212213 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d716283-0704-4ec4-9816-079c2bedb376 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:38.213642 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d716283-0704-4ec4-9816-079c2bedb376 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:38.223096 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 441/871] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:16:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:38.230266 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ec593-d455-440c-a3c3-ec3b97a20c56 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:38.316816 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:38.348358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ec593-d455-440c-a3c3-ec3b97a20c56 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:38.386547 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6572aa-0154-4639-853b-877fc4271a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:38.387396 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6572aa-0154-4639-853b-877fc4271a19 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:38.387722 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6572aa-0154-4639-853b-877fc4271a19 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:38.387978 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6572aa-0154-4639-853b-877fc4271a19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:38.401067 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6572aa-0154-4639-853b-877fc4271a19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:38.402641 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6572aa-0154-4639-853b-877fc4271a19 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:38.421061 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-6e6572aa-0154-4639-853b-877fc4271a19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:38.421061 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:38.421061 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:38.421061 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:38.421061 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:38.421061 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:38.421061 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:38.421061 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:38.421061 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:38.421061 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:38.421061 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:38.421061 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:38.421061 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:16:38.421061 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:16:38.421061 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:16:38.422263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:16:38.422263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:38.422263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:38.422263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:38.422263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:38.422263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:38.422263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:38.422263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:38.422263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:38.422263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:38.422263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:38.422263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:38.422263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:38.422263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:38.422263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:38.422263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:38.422263 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:38.423407 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:16:38.423407 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:16:38.423407 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:38.423407 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:16:38.423407 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 431/872] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:38.428833 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d716283-0704-4ec4-9816-079c2bedb376 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:38.545882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d716283-0704-4ec4-9816-079c2bedb376 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:38.587591 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7e5c2-b817-41e5-b1cc-f047af824099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:38.588187 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7e5c2-b817-41e5-b1cc-f047af824099 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:38.588469 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7e5c2-b817-41e5-b1cc-f047af824099 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:38.588738 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7e5c2-b817-41e5-b1cc-f047af824099 None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:38.589593 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7e5c2-b817-41e5-b1cc-f047af824099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:38.589897 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7e5c2-b817-41e5-b1cc-f047af824099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:38.591600 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7e5c2-b817-41e5-b1cc-f047af824099 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:38.606040 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 442/873] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:38.612365 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6572aa-0154-4639-853b-877fc4271a19 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:38.724951 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6572aa-0154-4639-853b-877fc4271a19 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:38.753941 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:38.763138 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc592e-cace-448c-866d-2053b978ba45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:38.764104 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc592e-cace-448c-866d-2053b978ba45 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:38.764519 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc592e-cace-448c-866d-2053b978ba45 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:38.764803 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc592e-cace-448c-866d-2053b978ba45 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:38.773320 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc592e-cace-448c-866d-2053b978ba45 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:38.774966 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc592e-cace-448c-866d-2053b978ba45 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:38.789490 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-5ffc592e-cace-448c-866d-2053b978ba45 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 17:16:38.789490 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:38.789490 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:38.789490 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:38.789490 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:38.789490 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:38.789490 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:38.789490 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:38.789490 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:38.789490 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:38.789490 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:38.789490 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:38.789490 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 17:16:38.789490 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 17:16:38.789490 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 17:16:38.789490 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 17:16:38.790938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:38.790938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:38.790938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 17:16:38.790938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:16:38.790938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 17:16:38.790938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:16:38.790938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:38.790938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:38.790938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:38.790938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:38.790938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:38.790938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:38.790938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:38.790938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:38.790938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:38.790938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:38.790938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:38.790938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:38.792269 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:38.792269 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:38.792269 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 17:16:38.792269 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 17:16:38.792269 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 17:16:38.792269 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 17:16:38.792269 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 17:16:38.792269 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 17:16:38.792269 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 17:16:38.792269 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:16:38.798280 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 432/874] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:16:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:38.798498 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7e5c2-b817-41e5-b1cc-f047af824099 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:38.855190 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:38.914443 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7e5c2-b817-41e5-b1cc-f047af824099 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:38.951876 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0a2c1-bfb5-4b9f-b2ea-c8dda8b6cbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:38.952553 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0a2c1-bfb5-4b9f-b2ea-c8dda8b6cbeb None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:38.952832 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0a2c1-bfb5-4b9f-b2ea-c8dda8b6cbeb None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:38.953105 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0a2c1-bfb5-4b9f-b2ea-c8dda8b6cbeb None admin] PATH_INFO: `/v3/users` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:38.953934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0a2c1-bfb5-4b9f-b2ea-c8dda8b6cbeb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:38.954236 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0a2c1-bfb5-4b9f-b2ea-c8dda8b6cbeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:38.955743 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0a2c1-bfb5-4b9f-b2ea-c8dda8b6cbeb None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:38.974298 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 443/875] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Jun 24 17:16:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:38.980233 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc592e-cace-448c-866d-2053b978ba45 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:39.102560 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc592e-cace-448c-866d-2053b978ba45 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:39.139856 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecf7bd-53d2-4f09-baa1-1b4a7d69d426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:39.140442 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecf7bd-53d2-4f09-baa1-1b4a7d69d426 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:39.140826 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecf7bd-53d2-4f09-baa1-1b4a7d69d426 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:39.141200 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecf7bd-53d2-4f09-baa1-1b4a7d69d426 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:39.206597 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:39.220799 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adecf7bd-53d2-4f09-baa1-1b4a7d69d426 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:39.223114 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adecf7bd-53d2-4f09-baa1-1b4a7d69d426 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:39.332221 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 433/876] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:16:38 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 17:16:39.338192 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0a2c1-bfb5-4b9f-b2ea-c8dda8b6cbeb None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:39.449198 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0a2c1-bfb5-4b9f-b2ea-c8dda8b6cbeb None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:39.458802 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:39.486789 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b004600-60d3-43c1-aaa2-e700498d8744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:39.487594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b004600-60d3-43c1-aaa2-e700498d8744 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:39.487942 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b004600-60d3-43c1-aaa2-e700498d8744 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:39.488218 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b004600-60d3-43c1-aaa2-e700498d8744 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:39.498955 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b004600-60d3-43c1-aaa2-e700498d8744 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:39.500435 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b004600-60d3-43c1-aaa2-e700498d8744 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:39.518957 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-4b004600-60d3-43c1-aaa2-e700498d8744 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:39.518957 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:39.518957 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:39.518957 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:39.518957 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:39.518957 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:39.518957 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:39.518957 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:39.518957 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:39.518957 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:39.518957 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:39.518957 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:39.518957 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:16:39.518957 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:16:39.518957 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:16:39.520089 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:16:39.520089 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:39.520089 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:39.520089 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:39.520089 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:39.520089 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:39.520089 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:39.520089 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:39.520089 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:39.520089 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:39.520089 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:39.520089 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:39.520089 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:39.520089 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:39.520089 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:39.520089 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:39.520089 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:39.521778 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:16:39.521778 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:16:39.521778 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:39.521778 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:16:39.525488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 444/877] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:39.526564 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecf7bd-53d2-4f09-baa1-1b4a7d69d426 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:39.630274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:39.643552 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecf7bd-53d2-4f09-baa1-1b4a7d69d426 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:39.681524 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc43b1-27e3-4d08-9ddd-32951a2133c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:39.682194 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc43b1-27e3-4d08-9ddd-32951a2133c8 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:39.682470 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc43b1-27e3-4d08-9ddd-32951a2133c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:39.682801 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc43b1-27e3-4d08-9ddd-32951a2133c8 None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:39.683494 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc43b1-27e3-4d08-9ddd-32951a2133c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:39.683797 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc43b1-27e3-4d08-9ddd-32951a2133c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:39.685227 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc43b1-27e3-4d08-9ddd-32951a2133c8 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:39.697222 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 434/878] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:39.703196 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b004600-60d3-43c1-aaa2-e700498d8744 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:39.806993 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b004600-60d3-43c1-aaa2-e700498d8744 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:39.844345 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3fdb5-d6b3-462d-b689-e83f9dc95a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:39.845167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3fdb5-d6b3-462d-b689-e83f9dc95a9c None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:39.845524 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3fdb5-d6b3-462d-b689-e83f9dc95a9c None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:39.845799 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3fdb5-d6b3-462d-b689-e83f9dc95a9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:39.854654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3fdb5-d6b3-462d-b689-e83f9dc95a9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:39.856111 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3fdb5-d6b3-462d-b689-e83f9dc95a9c None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:39.871147 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-73f3fdb5-d6b3-462d-b689-e83f9dc95a9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:16:39.871147 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:39.871147 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:39.871147 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:39.871147 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:39.871147 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:39.871147 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:39.871147 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:39.871147 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:39.871147 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:39.871147 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:39.871147 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:39.871147 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 17:16:39.871147 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 17:16:39.871147 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 17:16:39.872225 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 17:16:39.872225 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:39.872225 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:39.872225 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:39.872225 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:39.872225 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:39.872225 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:39.872225 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:39.872225 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:39.872225 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:39.872225 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:39.872225 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:39.872225 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:39.872225 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:39.872225 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:39.872225 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:39.872225 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:39.873106 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 17:16:39.873106 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 17:16:39.873106 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 17:16:39.873106 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 17:16:39.873106 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 17:16:39.873106 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 17:16:39.873106 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:16:39.873106 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:16:39.873106 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 445/879] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:16:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:39.878560 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc43b1-27e3-4d08-9ddd-32951a2133c8 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:39.987323 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc43b1-27e3-4d08-9ddd-32951a2133c8 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:40.028153 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9acb4b-be27-4139-bcb2-33dfe4ead29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:40.028990 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9acb4b-be27-4139-bcb2-33dfe4ead29f None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:40.029365 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9acb4b-be27-4139-bcb2-33dfe4ead29f None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:40.029729 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9acb4b-be27-4139-bcb2-33dfe4ead29f None admin] PATH_INFO: `/v3/projects` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:40.030690 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9acb4b-be27-4139-bcb2-33dfe4ead29f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:40.031027 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9acb4b-be27-4139-bcb2-33dfe4ead29f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:40.032774 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9acb4b-be27-4139-bcb2-33dfe4ead29f None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:40.049281 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 435/880] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 24 17:16:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:40.055960 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3fdb5-d6b3-462d-b689-e83f9dc95a9c None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:40.082254 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:40.167631 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3fdb5-d6b3-462d-b689-e83f9dc95a9c None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:40.203358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca36eb4-a7f7-48fa-ac44-0ce05ad772c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:40.204010 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca36eb4-a7f7-48fa-ac44-0ce05ad772c1 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:40.204300 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca36eb4-a7f7-48fa-ac44-0ce05ad772c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:40.204558 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca36eb4-a7f7-48fa-ac44-0ce05ad772c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:40.205417 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca36eb4-a7f7-48fa-ac44-0ce05ad772c1 None admin] RBAC: Adding query filter params (role.id=ae295b7c396a4e559ecd6d574f097d4a, scope.project.id=fb66039441c14b96a79a30de4a833fa2, user.id=b318b7cfb1c5485cba96997ddd73945c) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:40.205722 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca36eb4-a7f7-48fa-ac44-0ce05ad772c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:40.207295 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca36eb4-a7f7-48fa-ac44-0ce05ad772c1 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:40.212990 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 446/881] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:16:40 2022] GET /identity/v3/role_assignments?user.id=b318b7cfb1c5485cba96997ddd73945c&scope.project.id=fb66039441c14b96a79a30de4a833fa2&role.id=ae295b7c396a4e559ecd6d574f097d4a => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:42.620041 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27ad43-30b1-4389-8794-94dd27e637e0 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:42.620627 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27ad43-30b1-4389-8794-94dd27e637e0 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:42.620627 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27ad43-30b1-4389-8794-94dd27e637e0 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:42.621976 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 436/882] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:16:42.627300 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a5ee0-7aeb-4761-91d3-4ed7af36970e None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:42.627756 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a5ee0-7aeb-4761-91d3-4ed7af36970e None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:42.627848 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a5ee0-7aeb-4761-91d3-4ed7af36970e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:42.646730 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-2c0a5ee0-7aeb-4761-91d3-4ed7af36970e None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:16:42.647921 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-2c0a5ee0-7aeb-4761-91d3-4ed7af36970e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:16:42.725469 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 447/883] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:16:42 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:16:42.750527 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27ad43-30b1-4389-8794-94dd27e637e0 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:42.764436 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:42.879611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27ad43-30b1-4389-8794-94dd27e637e0 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:42.914309 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40958a04-973b-48a0-ab6d-33211afcc554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:42.915114 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40958a04-973b-48a0-ab6d-33211afcc554 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:42.915394 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40958a04-973b-48a0-ab6d-33211afcc554 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:42.915664 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40958a04-973b-48a0-ab6d-33211afcc554 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:42.926192 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40958a04-973b-48a0-ab6d-33211afcc554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:16:42.933830 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-40958a04-973b-48a0-ab6d-33211afcc554 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:16:42.933830 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:42.933830 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:42.933830 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:42.933830 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:42.933830 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:42.933830 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:42.933830 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:42.933830 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:42.933830 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:42.933830 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:42.933830 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:42.933830 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:16:42.933830 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:16:42.933830 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:16:42.933830 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:16:42.934808 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:16:42.934808 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:16:42.934808 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:16:42.934808 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:16:42.934808 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:42.934808 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:42.934808 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:42.934808 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:42.934808 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:42.934808 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:42.934808 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:42.934808 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:42.934808 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:42.934808 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:42.934808 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:42.934808 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:42.935739 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:42.935739 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:42.935739 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:42.935739 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:42.935739 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:16:42.935739 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:16:42.935739 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:16:42.935739 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:16:42.935739 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:16:42.935739 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:16:42.935739 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:16:42.935739 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:16:42.935739 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 437/884] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 24 17:16:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:42.941572 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a5ee0-7aeb-4761-91d3-4ed7af36970e None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:42.959047 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:43.063015 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a5ee0-7aeb-4761-91d3-4ed7af36970e None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:43.102247 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7aa9e8-fb33-43fc-a0df-1cbed0cff149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:43.102952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aa9e8-fb33-43fc-a0df-1cbed0cff149 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:43.103228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aa9e8-fb33-43fc-a0df-1cbed0cff149 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:43.103499 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aa9e8-fb33-43fc-a0df-1cbed0cff149 None admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:43.104243 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7aa9e8-fb33-43fc-a0df-1cbed0cff149 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:43.104552 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7aa9e8-fb33-43fc-a0df-1cbed0cff149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:43.105922 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7aa9e8-fb33-43fc-a0df-1cbed0cff149 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:43.115075 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 448/885] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:16:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:43.121070 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40958a04-973b-48a0-ab6d-33211afcc554 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:43.204835 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:43.241599 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40958a04-973b-48a0-ab6d-33211afcc554 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:43.276467 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dd711-cccd-4c4d-998a-28c67e82321b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:43.277242 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dd711-cccd-4c4d-998a-28c67e82321b None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:43.277511 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dd711-cccd-4c4d-998a-28c67e82321b None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:43.277776 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dd711-cccd-4c4d-998a-28c67e82321b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:43.288878 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7dd711-cccd-4c4d-998a-28c67e82321b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:43.290504 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7dd711-cccd-4c4d-998a-28c67e82321b None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:43.312983 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-9b7dd711-cccd-4c4d-998a-28c67e82321b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:43.312983 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:43.312983 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:43.312983 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:43.312983 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:43.312983 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:43.312983 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:43.312983 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:43.312983 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:43.312983 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:43.312983 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:43.312983 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:43.312983 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:16:43.312983 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:16:43.312983 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:16:43.314166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:16:43.314166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:43.314166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:43.314166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:43.314166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:43.314166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:43.314166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:43.314166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:43.314166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:43.314166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:43.314166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:43.314166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:43.314166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:43.314166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:43.314166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:43.314166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:43.314166 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:43.317000 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:16:43.317000 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:16:43.317000 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:43.317000 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:16:43.317000 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 438/886] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:43.322220 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7aa9e8-fb33-43fc-a0df-1cbed0cff149 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:43.400953 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:43.424307 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7aa9e8-fb33-43fc-a0df-1cbed0cff149 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:43.458649 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45c818-3576-4454-84e9-4add6d5eedc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:43.459229 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45c818-3576-4454-84e9-4add6d5eedc3 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:43.459503 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45c818-3576-4454-84e9-4add6d5eedc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:43.459768 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45c818-3576-4454-84e9-4add6d5eedc3 None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:43.460493 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45c818-3576-4454-84e9-4add6d5eedc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:43.460787 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45c818-3576-4454-84e9-4add6d5eedc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:43.462280 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45c818-3576-4454-84e9-4add6d5eedc3 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:43.473847 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 449/887] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:43.480921 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dd711-cccd-4c4d-998a-28c67e82321b None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:43.597197 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dd711-cccd-4c4d-998a-28c67e82321b None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:43.618886 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:43.633262 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573fdff-846a-4873-82af-d443fca17150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:43.634063 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573fdff-846a-4873-82af-d443fca17150 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:43.634334 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573fdff-846a-4873-82af-d443fca17150 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:43.634627 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573fdff-846a-4873-82af-d443fca17150 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:43.642170 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573fdff-846a-4873-82af-d443fca17150 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:43.643664 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573fdff-846a-4873-82af-d443fca17150 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:43.658601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-6573fdff-846a-4873-82af-d443fca17150 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 17:16:43.658601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:43.658601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:43.658601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:43.658601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:43.658601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:43.658601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:43.658601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:43.658601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:43.658601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:43.658601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:43.658601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:43.658601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 17:16:43.658601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 17:16:43.658601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 17:16:43.658601 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 17:16:43.659719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:43.659719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:43.659719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 17:16:43.659719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:16:43.659719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 17:16:43.659719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:16:43.659719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:43.659719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:43.659719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:43.659719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:43.659719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:43.659719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:43.659719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:43.659719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:43.659719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:43.659719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:43.659719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:43.659719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:43.660681 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:43.660681 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:43.660681 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 17:16:43.660681 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 17:16:43.660681 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 17:16:43.660681 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 17:16:43.660681 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 17:16:43.660681 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 17:16:43.660681 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 17:16:43.660681 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:16:43.660681 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 439/888] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:16:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:43.666068 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45c818-3576-4454-84e9-4add6d5eedc3 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:43.775914 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45c818-3576-4454-84e9-4add6d5eedc3 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:43.810741 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00593a-ed66-4a86-8350-c5113ca2f762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:43.811391 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00593a-ed66-4a86-8350-c5113ca2f762 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:43.811668 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00593a-ed66-4a86-8350-c5113ca2f762 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:43.811939 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00593a-ed66-4a86-8350-c5113ca2f762 None admin] PATH_INFO: `/v3/users` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:43.812759 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00593a-ed66-4a86-8350-c5113ca2f762 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:43.813067 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00593a-ed66-4a86-8350-c5113ca2f762 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:43.814504 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00593a-ed66-4a86-8350-c5113ca2f762 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:43.817095 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:43.832049 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 450/889] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Jun 24 17:16:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:43.839295 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573fdff-846a-4873-82af-d443fca17150 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:43.946226 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573fdff-846a-4873-82af-d443fca17150 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:43.986180 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f401f2-d7e6-4d39-b244-adecbce972ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:43.987011 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f401f2-d7e6-4d39-b244-adecbce972ca None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:43.987287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f401f2-d7e6-4d39-b244-adecbce972ca None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:43.987562 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f401f2-d7e6-4d39-b244-adecbce972ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:43.999198 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f401f2-d7e6-4d39-b244-adecbce972ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:44.000791 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f401f2-d7e6-4d39-b244-adecbce972ca None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:44.018920 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-80f401f2-d7e6-4d39-b244-adecbce972ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:44.018920 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:44.018920 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:44.018920 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:44.018920 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:44.018920 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:44.018920 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:44.018920 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:44.018920 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:44.018920 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:44.018920 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:44.018920 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:44.018920 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:16:44.018920 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:16:44.018920 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:16:44.019820 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:16:44.019820 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:44.019820 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:44.019820 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:44.019820 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:44.019820 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:44.019820 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:44.019820 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:44.019820 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:44.019820 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:44.019820 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:44.019820 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:44.019820 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:44.019820 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:44.019820 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:44.019820 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:44.019820 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:44.020959 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:16:44.020959 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:16:44.020959 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:44.020959 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:16:44.020959 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 440/890] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:44.026320 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00593a-ed66-4a86-8350-c5113ca2f762 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:44.133443 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00593a-ed66-4a86-8350-c5113ca2f762 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:44.168117 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574524e1-83db-497b-a074-480f06f5a426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:44.168761 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574524e1-83db-497b-a074-480f06f5a426 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:44.169032 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574524e1-83db-497b-a074-480f06f5a426 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:44.169300 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574524e1-83db-497b-a074-480f06f5a426 None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:44.170004 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574524e1-83db-497b-a074-480f06f5a426 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:44.170301 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574524e1-83db-497b-a074-480f06f5a426 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:44.171700 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574524e1-83db-497b-a074-480f06f5a426 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:44.182845 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 451/891] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:44.192045 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f401f2-d7e6-4d39-b244-adecbce972ca None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:44.227206 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:44.306005 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f401f2-d7e6-4d39-b244-adecbce972ca None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:44.354553 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7e8b9-a32f-4655-93a8-8acb81f88fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:44.355357 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7e8b9-a32f-4655-93a8-8acb81f88fa3 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:44.355634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7e8b9-a32f-4655-93a8-8acb81f88fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:44.355892 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7e8b9-a32f-4655-93a8-8acb81f88fa3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:44.362710 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7e8b9-a32f-4655-93a8-8acb81f88fa3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:44.364184 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7e8b9-a32f-4655-93a8-8acb81f88fa3 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:44.379128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-f0d7e8b9-a32f-4655-93a8-8acb81f88fa3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:16:44.379128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:44.379128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:44.379128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:44.379128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:44.379128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:44.379128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:44.379128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:44.379128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:44.379128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:44.379128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:44.379128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:44.379128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 17:16:44.379128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 17:16:44.379128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 17:16:44.380122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 17:16:44.380122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:44.380122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:44.380122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:44.380122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:44.380122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:44.380122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:44.380122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:44.380122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:44.380122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:44.380122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:44.380122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:44.380122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:44.380122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:44.380122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:44.380122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:44.380122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:44.381236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 17:16:44.381236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 17:16:44.381236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 17:16:44.381236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 17:16:44.381236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 17:16:44.381236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 17:16:44.381236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:16:44.381236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:16:44.381236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 441/892] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:16:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:44.388105 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574524e1-83db-497b-a074-480f06f5a426 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:44.449178 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:44.498011 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574524e1-83db-497b-a074-480f06f5a426 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:44.534683 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60c6f3-204d-44ce-be7c-284b28280a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:44.535519 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60c6f3-204d-44ce-be7c-284b28280a82 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:44.535951 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60c6f3-204d-44ce-be7c-284b28280a82 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:44.536311 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60c6f3-204d-44ce-be7c-284b28280a82 None admin] PATH_INFO: `/v3/projects` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:44.537328 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60c6f3-204d-44ce-be7c-284b28280a82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:44.537838 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60c6f3-204d-44ce-be7c-284b28280a82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:44.540352 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60c6f3-204d-44ce-be7c-284b28280a82 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:44.557864 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 452/893] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 24 17:16:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:44.564952 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7e8b9-a32f-4655-93a8-8acb81f88fa3 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:44.654105 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:44.663767 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7e8b9-a32f-4655-93a8-8acb81f88fa3 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:44.696537 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41bbc1-72a1-4648-9dca-36d26d356080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:44.697441 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41bbc1-72a1-4648-9dca-36d26d356080 None admin] REQUEST_METHOD: `PUT` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:44.697718 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41bbc1-72a1-4648-9dca-36d26d356080 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:44.697982 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41bbc1-72a1-4648-9dca-36d26d356080 None admin] PATH_INFO: `/v3/projects/fb66039441c14b96a79a30de4a833fa2/users/b318b7cfb1c5485cba96997ddd73945c/roles/ae295b7c396a4e559ecd6d574f097d4a` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:44.700196 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41bbc1-72a1-4648-9dca-36d26d356080 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb66039441c14b96a79a30de4a833fa2, user_id=b318b7cfb1c5485cba96997ddd73945c, role_id=ae295b7c396a4e559ecd6d574f097d4a)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:44.701634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41bbc1-72a1-4648-9dca-36d26d356080 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:44.718374 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 442/894] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 24 17:16:44 2022] PUT /identity/v3/projects/fb66039441c14b96a79a30de4a833fa2/users/b318b7cfb1c5485cba96997ddd73945c/roles/ae295b7c396a4e559ecd6d574f097d4a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:16:47.034208 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddf915-8dd7-419a-bf95-0c423113dd5a None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:47.034708 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddf915-8dd7-419a-bf95-0c423113dd5a None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:47.034811 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddf915-8dd7-419a-bf95-0c423113dd5a None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:47.036133 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 453/895] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:16:47.043878 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2ef45-6c3c-4f39-ab00-c4b8060af664 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:47.044348 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2ef45-6c3c-4f39-ab00-c4b8060af664 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:47.044462 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2ef45-6c3c-4f39-ab00-c4b8060af664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:47.062800 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-dca2ef45-6c3c-4f39-ab00-c4b8060af664 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:16:47.063977 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-dca2ef45-6c3c-4f39-ab00-c4b8060af664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:16:47.135379 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 443/896] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:16:47 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:16:47.174362 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ddf915-8dd7-419a-bf95-0c423113dd5a None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:47.285302 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ddf915-8dd7-419a-bf95-0c423113dd5a None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:47.299392 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:47.320455 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bab43-9a2d-48d8-ab0a-f0413f980215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:47.321231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bab43-9a2d-48d8-ab0a-f0413f980215 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:47.321512 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bab43-9a2d-48d8-ab0a-f0413f980215 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:47.321779 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bab43-9a2d-48d8-ab0a-f0413f980215 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:47.332319 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bab43-9a2d-48d8-ab0a-f0413f980215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 17:16:47.340047 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-286bab43-9a2d-48d8-ab0a-f0413f980215 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:16:47.340047 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:47.340047 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:47.340047 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:47.340047 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:47.340047 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:47.340047 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:47.340047 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:47.340047 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:47.340047 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:47.340047 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:47.340047 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:47.340047 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 17:16:47.340047 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 17:16:47.340047 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 17:16:47.340047 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 17:16:47.341117 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 17:16:47.341117 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 17:16:47.341117 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 17:16:47.341117 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 17:16:47.341117 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:47.341117 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:47.341117 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:47.341117 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:47.341117 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:47.341117 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:47.341117 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:47.341117 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:47.341117 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:47.341117 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:47.341117 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:47.341117 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:47.341965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:47.341965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:47.341965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:47.341965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:47.341965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 17:16:47.341965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 17:16:47.341965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 17:16:47.341965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 17:16:47.341965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 17:16:47.341965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 17:16:47.341965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 17:16:47.341965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:16:47.341965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 454/897] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 24 17:16:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:47.348223 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2ef45-6c3c-4f39-ab00-c4b8060af664 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:47.442721 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:47.464847 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2ef45-6c3c-4f39-ab00-c4b8060af664 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:47.500796 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f86e51-dd21-4091-a128-e9fce809134f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:47.501451 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f86e51-dd21-4091-a128-e9fce809134f None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:47.501730 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f86e51-dd21-4091-a128-e9fce809134f None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:47.502000 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f86e51-dd21-4091-a128-e9fce809134f None admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:47.502775 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f86e51-dd21-4091-a128-e9fce809134f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:47.503078 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f86e51-dd21-4091-a128-e9fce809134f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:47.504465 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f86e51-dd21-4091-a128-e9fce809134f None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:47.512812 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 444/898] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 24 17:16:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:47.519358 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bab43-9a2d-48d8-ab0a-f0413f980215 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:47.633238 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bab43-9a2d-48d8-ab0a-f0413f980215 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:47.677215 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815430f-a5d8-458e-9b6f-1790e9b1a6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:47.678009 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815430f-a5d8-458e-9b6f-1790e9b1a6d2 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:47.678290 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815430f-a5d8-458e-9b6f-1790e9b1a6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:47.678593 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815430f-a5d8-458e-9b6f-1790e9b1a6d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:47.690062 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3815430f-a5d8-458e-9b6f-1790e9b1a6d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:47.691553 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3815430f-a5d8-458e-9b6f-1790e9b1a6d2 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:47.708523 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-3815430f-a5d8-458e-9b6f-1790e9b1a6d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:47.708523 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:47.708523 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:47.708523 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:47.708523 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:47.708523 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:47.708523 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:47.708523 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:47.708523 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:47.708523 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:47.708523 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:47.708523 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:47.708523 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:16:47.708523 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:16:47.708523 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:16:47.709594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:16:47.709594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:47.709594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:47.709594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:47.709594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:47.709594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:47.709594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:47.709594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:47.709594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:47.709594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:47.709594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:47.709594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:47.709594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:47.709594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:47.709594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:47.709594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:47.709594 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:47.710742 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:16:47.710742 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:16:47.710742 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:47.710742 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:16:47.710742 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 455/899] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:47.715987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f86e51-dd21-4091-a128-e9fce809134f None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:47.825422 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f86e51-dd21-4091-a128-e9fce809134f None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:47.860245 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6e9f8-03bb-4600-af63-ff572425091a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:47.860883 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6e9f8-03bb-4600-af63-ff572425091a None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:47.861155 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6e9f8-03bb-4600-af63-ff572425091a None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:47.861419 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6e9f8-03bb-4600-af63-ff572425091a None admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:47.862128 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6e9f8-03bb-4600-af63-ff572425091a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:47.862425 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6e9f8-03bb-4600-af63-ff572425091a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:47.863823 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6e9f8-03bb-4600-af63-ff572425091a None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:47.875708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 445/900] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 17:16:47.882005 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815430f-a5d8-458e-9b6f-1790e9b1a6d2 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:47.912750 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:47.992758 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815430f-a5d8-458e-9b6f-1790e9b1a6d2 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:48.029993 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7ff0c-92ad-48ef-93d9-9e5c7c364493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:48.030847 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7ff0c-92ad-48ef-93d9-9e5c7c364493 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:48.031212 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7ff0c-92ad-48ef-93d9-9e5c7c364493 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:48.031333 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7ff0c-92ad-48ef-93d9-9e5c7c364493 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:48.041423 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7ff0c-92ad-48ef-93d9-9e5c7c364493 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:48.042920 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7ff0c-92ad-48ef-93d9-9e5c7c364493 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:48.058072 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-42b7ff0c-92ad-48ef-93d9-9e5c7c364493 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 17:16:48.058072 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:48.058072 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:48.058072 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:48.058072 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:48.058072 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:48.058072 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:48.058072 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:48.058072 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:48.058072 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:48.058072 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:48.058072 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:48.058072 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 17:16:48.058072 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 17:16:48.058072 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 17:16:48.058072 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 17:16:48.059211 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:48.059211 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:48.059211 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 17:16:48.059211 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:16:48.059211 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 17:16:48.059211 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 17:16:48.059211 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:48.059211 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:48.059211 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:48.059211 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:48.059211 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:48.059211 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:48.059211 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:48.059211 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:48.059211 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:48.059211 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:48.059211 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:48.059211 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:48.060144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:48.060144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:48.060144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 17:16:48.060144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 17:16:48.060144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 17:16:48.060144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 17:16:48.060144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 17:16:48.060144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 17:16:48.060144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 17:16:48.060144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:16:48.060144 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 456/901] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:16:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:48.065510 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6e9f8-03bb-4600-af63-ff572425091a None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:48.069574 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:48.181579 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6e9f8-03bb-4600-af63-ff572425091a None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:48.217480 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a232042-7885-4d32-8188-5cef341f0564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:48.218146 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a232042-7885-4d32-8188-5cef341f0564 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:48.218424 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a232042-7885-4d32-8188-5cef341f0564 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:48.218720 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a232042-7885-4d32-8188-5cef341f0564 None admin] PATH_INFO: `/v3/users` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:48.219560 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a232042-7885-4d32-8188-5cef341f0564 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:48.219862 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a232042-7885-4d32-8188-5cef341f0564 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:48.221336 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a232042-7885-4d32-8188-5cef341f0564 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:48.240719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 446/902] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Jun 24 17:16:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:48.247475 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7ff0c-92ad-48ef-93d9-9e5c7c364493 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:48.358406 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:48.376342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7ff0c-92ad-48ef-93d9-9e5c7c364493 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:48.413334 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563efcb-d6d0-4b2d-a3b1-fd44548fdee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:48.413966 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563efcb-d6d0-4b2d-a3b1-fd44548fdee7 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:48.414240 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563efcb-d6d0-4b2d-a3b1-fd44548fdee7 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:48.414506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563efcb-d6d0-4b2d-a3b1-fd44548fdee7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:48.486425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563efcb-d6d0-4b2d-a3b1-fd44548fdee7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:48.487821 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563efcb-d6d0-4b2d-a3b1-fd44548fdee7 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:48.577038 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:48.595301 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 457/903] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 24 17:16:48 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 17:16:48.604466 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a232042-7885-4d32-8188-5cef341f0564 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:48.667410 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:48.708074 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a232042-7885-4d32-8188-5cef341f0564 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:48.747888 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56d638-1b36-4666-951b-a62eb43212c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:48.748606 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56d638-1b36-4666-951b-a62eb43212c4 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:48.748874 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56d638-1b36-4666-951b-a62eb43212c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:48.749139 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56d638-1b36-4666-951b-a62eb43212c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:48.760010 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56d638-1b36-4666-951b-a62eb43212c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:48.761517 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56d638-1b36-4666-951b-a62eb43212c4 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:48.779317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-7b56d638-1b36-4666-951b-a62eb43212c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:48.779317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:48.779317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:48.779317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:48.779317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:48.779317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:48.779317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:48.779317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:48.779317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:48.779317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:48.779317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:48.779317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:48.779317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 17:16:48.779317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 17:16:48.779317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 17:16:48.780292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 17:16:48.780292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:48.780292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:48.780292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:48.780292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:48.780292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:48.780292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:48.780292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:48.780292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:48.780292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:48.780292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:48.780292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:48.780292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:48.780292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:48.780292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:48.780292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:48.780292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:48.781491 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 17:16:48.781491 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 17:16:48.781491 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 17:16:48.781491 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:16:48.781491 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 447/904] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 17:16:48.789873 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563efcb-d6d0-4b2d-a3b1-fd44548fdee7 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:48.898059 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563efcb-d6d0-4b2d-a3b1-fd44548fdee7 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:48.932472 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8099b-a57f-4050-af7e-c17c7f13ec36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:48.933179 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8099b-a57f-4050-af7e-c17c7f13ec36 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:48.933461 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8099b-a57f-4050-af7e-c17c7f13ec36 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:48.933728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8099b-a57f-4050-af7e-c17c7f13ec36 None admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:48.934435 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8099b-a57f-4050-af7e-c17c7f13ec36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:48.934760 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8099b-a57f-4050-af7e-c17c7f13ec36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:48.936121 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8099b-a57f-4050-af7e-c17c7f13ec36 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:48.947390 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 458/905] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 24 17:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:48.956538 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56d638-1b36-4666-951b-a62eb43212c4 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:49.066274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56d638-1b36-4666-951b-a62eb43212c4 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:49.080447 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:49.102230 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a3707-0121-4147-917d-a04574c32b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:49.103400 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a3707-0121-4147-917d-a04574c32b08 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:49.103675 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a3707-0121-4147-917d-a04574c32b08 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:49.103938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a3707-0121-4147-917d-a04574c32b08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:49.110943 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a3707-0121-4147-917d-a04574c32b08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:49.112393 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a3707-0121-4147-917d-a04574c32b08 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:49.126597 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application [None req-c75a3707-0121-4147-917d-a04574c32b08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:16:49.126597 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:49.126597 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:49.126597 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:49.126597 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:49.126597 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:49.126597 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:49.126597 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:49.126597 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:49.126597 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:49.126597 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:49.126597 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:49.126597 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 17:16:49.126597 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 17:16:49.126597 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 17:16:49.127587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 17:16:49.127587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:49.127587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:49.127587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:49.127587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:49.127587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:49.127587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:49.127587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:49.127587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:49.127587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:49.127587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:49.127587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:49.127587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:49.127587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:49.127587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:49.127587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:49.127587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:49.128497 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 17:16:49.128497 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 17:16:49.128497 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 17:16:49.128497 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 17:16:49.128497 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 17:16:49.128497 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 17:16:49.128497 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 17:16:49.128497 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: ERROR keystone.server.flask.application Jun 24 17:16:49.128497 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 448/906] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 24 17:16:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:49.134443 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8099b-a57f-4050-af7e-c17c7f13ec36 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:49.190486 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:49.245975 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8099b-a57f-4050-af7e-c17c7f13ec36 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:49.289228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3905f-d77d-401d-8908-e39d5d8f85a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:49.290066 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3905f-d77d-401d-8908-e39d5d8f85a2 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:49.290439 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3905f-d77d-401d-8908-e39d5d8f85a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:49.290813 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3905f-d77d-401d-8908-e39d5d8f85a2 None admin] PATH_INFO: `/v3/projects` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:49.292008 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3905f-d77d-401d-8908-e39d5d8f85a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:49.292425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3905f-d77d-401d-8908-e39d5d8f85a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:49.294009 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3905f-d77d-401d-8908-e39d5d8f85a2 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:49.306384 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 459/907] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 24 17:16:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:49.312756 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a3707-0121-4147-917d-a04574c32b08 None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:49.420876 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a3707-0121-4147-917d-a04574c32b08 None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:49.455865 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c654218-797d-4e85-91fd-a8132df19fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:49.456505 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c654218-797d-4e85-91fd-a8132df19fa2 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:49.456776 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c654218-797d-4e85-91fd-a8132df19fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:49.457045 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c654218-797d-4e85-91fd-a8132df19fa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:49.457871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c654218-797d-4e85-91fd-a8132df19fa2 None admin] RBAC: Adding query filter params (role.id=ae295b7c396a4e559ecd6d574f097d4a, scope.project.id=fb66039441c14b96a79a30de4a833fa2, user.id=b318b7cfb1c5485cba96997ddd73945c) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:49.458172 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c654218-797d-4e85-91fd-a8132df19fa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:49.459634 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c654218-797d-4e85-91fd-a8132df19fa2 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:49.466337 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 449/908] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 24 17:16:49 2022] GET /identity/v3/role_assignments?user.id=b318b7cfb1c5485cba96997ddd73945c&scope.project.id=fb66039441c14b96a79a30de4a833fa2&role.id=ae295b7c396a4e559ecd6d574f097d4a => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:51.801426 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ebb7a-cbfb-4173-9c2e-e7d55c0dcb00 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:51.802016 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ebb7a-cbfb-4173-9c2e-e7d55c0dcb00 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:51.802016 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ebb7a-cbfb-4173-9c2e-e7d55c0dcb00 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:51.803371 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 460/909] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:16:51.809950 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c70c41-8e5a-427d-8508-21ef6d2f7a51 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:51.810382 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c70c41-8e5a-427d-8508-21ef6d2f7a51 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:51.810701 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c70c41-8e5a-427d-8508-21ef6d2f7a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:51.829914 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-62c70c41-8e5a-427d-8508-21ef6d2f7a51 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:16:51.831132 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-62c70c41-8e5a-427d-8508-21ef6d2f7a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:16:51.864010 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:51.904283 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 450/910] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:16:51 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:16:51.928654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ebb7a-cbfb-4173-9c2e-e7d55c0dcb00 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:52.041755 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ebb7a-cbfb-4173-9c2e-e7d55c0dcb00 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:52.050001 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:52.085855 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe05b3-91b0-48e9-8ece-96b70d41b1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:52.086914 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe05b3-91b0-48e9-8ece-96b70d41b1c9 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:52.087317 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe05b3-91b0-48e9-8ece-96b70d41b1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:52.087681 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe05b3-91b0-48e9-8ece-96b70d41b1c9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:52.088668 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe05b3-91b0-48e9-8ece-96b70d41b1c9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:52.090835 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe05b3-91b0-48e9-8ece-96b70d41b1c9 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:52.103896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-70fe05b3-91b0-48e9-8ece-96b70d41b1c9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 17:16:52.103896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:52.103896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 17:16:52.103896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 17:16:52.103896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 17:16:52.103896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 17:16:52.103896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 17:16:52.103896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:16:52.103896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 17:16:52.103896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:16:52.103896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:16:52.103896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:16:52.103896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:52.103896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:52.103896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:52.103896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:52.103896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:52.105381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:52.105381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:52.105381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:52.105381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:52.105381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:52.105381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:52.105381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 17:16:52.105381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 17:16:52.105381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 17:16:52.105381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 17:16:52.105381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:52.105381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:52.105381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:52.105381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:52.105381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:52.105381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:52.106222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:52.106222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:52.106222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:52.106222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:52.106222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:52.106222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:52.106222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:52.106222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:52.106222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:52.106222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:52.106222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 17:16:52.106222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:16:52.106222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 17:16:52.106222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:16:52.106222 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 461/911] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Jun 24 17:16:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:52.112497 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c70c41-8e5a-427d-8508-21ef6d2f7a51 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:52.237257 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c70c41-8e5a-427d-8508-21ef6d2f7a51 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:52.272967 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cba0de-4f8b-407e-9976-909bf331fbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:52.273614 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cba0de-4f8b-407e-9976-909bf331fbf8 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:52.273889 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cba0de-4f8b-407e-9976-909bf331fbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:52.274159 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cba0de-4f8b-407e-9976-909bf331fbf8 None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:52.274891 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cba0de-4f8b-407e-9976-909bf331fbf8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:52.275193 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cba0de-4f8b-407e-9976-909bf331fbf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:52.276570 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cba0de-4f8b-407e-9976-909bf331fbf8 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:52.281465 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 451/912] 10.222.0.15 () {56 vars in 1116 bytes} [Fri Jun 24 17:16:52 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:52.287529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe05b3-91b0-48e9-8ece-96b70d41b1c9 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:52.395896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe05b3-91b0-48e9-8ece-96b70d41b1c9 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:52.430092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917952f-a92f-4e4a-b6e4-c09f2411ac28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:52.430775 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917952f-a92f-4e4a-b6e4-c09f2411ac28 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:52.431051 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917952f-a92f-4e4a-b6e4-c09f2411ac28 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:52.431325 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917952f-a92f-4e4a-b6e4-c09f2411ac28 None admin] PATH_INFO: `/v3/services` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:52.432019 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917952f-a92f-4e4a-b6e4-c09f2411ac28 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:52.432328 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917952f-a92f-4e4a-b6e4-c09f2411ac28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:52.433696 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917952f-a92f-4e4a-b6e4-c09f2411ac28 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:52.438310 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 462/913] 10.222.0.15 () {56 vars in 1116 bytes} [Fri Jun 24 17:16:52 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:54.686836 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92034cde-caf9-4464-a221-fedb5e8bcc1a None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:54.687672 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92034cde-caf9-4464-a221-fedb5e8bcc1a None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:54.687672 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92034cde-caf9-4464-a221-fedb5e8bcc1a None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:54.689825 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 452/914] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:16:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:16:54.698219 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef5aac-36a8-41e4-b010-e429e4abb95e None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:54.698681 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef5aac-36a8-41e4-b010-e429e4abb95e None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:54.698809 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef5aac-36a8-41e4-b010-e429e4abb95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:54.717556 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-c9ef5aac-36a8-41e4-b010-e429e4abb95e None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:16:54.718786 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-c9ef5aac-36a8-41e4-b010-e429e4abb95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:16:54.748708 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:54.792625 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 463/915] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:16:54 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:16:54.823447 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92034cde-caf9-4464-a221-fedb5e8bcc1a None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:54.853607 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:54.925705 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92034cde-caf9-4464-a221-fedb5e8bcc1a None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:54.959913 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd8f6d-19db-4a38-b206-2a06eab644dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:54.960494 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd8f6d-19db-4a38-b206-2a06eab644dd None admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:54.960773 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd8f6d-19db-4a38-b206-2a06eab644dd None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:54.961043 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd8f6d-19db-4a38-b206-2a06eab644dd None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:54.961759 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd8f6d-19db-4a38-b206-2a06eab644dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:54.963159 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd8f6d-19db-4a38-b206-2a06eab644dd None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:54.984510 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 453/916] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 24 17:16:54 2022] POST /identity/v3/services => generated 246 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:16:57.259043 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62854ba1-d7fb-408e-bc56-070bd1583063 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:57.259920 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62854ba1-d7fb-408e-bc56-070bd1583063 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:57.259920 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62854ba1-d7fb-408e-bc56-070bd1583063 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:57.262127 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 464/917] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:16:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:16:57.268429 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f6606-73d3-4945-8e29-5527bd42e80f None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:57.268856 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f6606-73d3-4945-8e29-5527bd42e80f None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:57.268987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f6606-73d3-4945-8e29-5527bd42e80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:57.291552 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-910f6606-73d3-4945-8e29-5527bd42e80f None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:16:57.292671 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-910f6606-73d3-4945-8e29-5527bd42e80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:16:57.372901 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 454/918] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:16:57 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:16:57.399070 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62854ba1-d7fb-408e-bc56-070bd1583063 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:57.505473 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62854ba1-d7fb-408e-bc56-070bd1583063 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:57.542274 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba56ae-ee5a-430e-beaf-a42df9ad0bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:57.543060 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba56ae-ee5a-430e-beaf-a42df9ad0bfb None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:57.543338 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba56ae-ee5a-430e-beaf-a42df9ad0bfb None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:57.543609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba56ae-ee5a-430e-beaf-a42df9ad0bfb None admin] PATH_INFO: `/v3/services/placement` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:57.544251 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba56ae-ee5a-430e-beaf-a42df9ad0bfb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:57.545633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba56ae-ee5a-430e-beaf-a42df9ad0bfb None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:57.558092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-8fba56ae-ee5a-430e-beaf-a42df9ad0bfb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 17:16:57.558092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:57.558092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 17:16:57.558092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 17:16:57.558092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 17:16:57.558092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 17:16:57.558092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 17:16:57.558092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:16:57.558092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 17:16:57.558092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:16:57.558092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:16:57.558092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:16:57.558092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:16:57.558092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:16:57.558092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:16:57.558092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:16:57.558092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:16:57.559180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:16:57.559180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:16:57.559180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:16:57.559180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:16:57.559180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:16:57.559180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:16:57.559180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 17:16:57.559180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 17:16:57.559180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 17:16:57.559180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 17:16:57.559180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:16:57.559180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:16:57.559180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:16:57.559180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:16:57.559180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:16:57.559180 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:16:57.560224 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:16:57.560224 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:16:57.560224 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:16:57.560224 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:16:57.560224 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:16:57.560224 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:16:57.560224 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:16:57.560224 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:16:57.560224 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:16:57.560224 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:16:57.560224 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 17:16:57.560224 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:16:57.560224 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 17:16:57.560224 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:16:57.560224 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 465/919] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Jun 24 17:16:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:16:57.566356 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f6606-73d3-4945-8e29-5527bd42e80f None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:57.590432 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:57.680488 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f6606-73d3-4945-8e29-5527bd42e80f None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:57.721244 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483ffe9-0e63-4177-a72d-ff8e2f25181b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:57.721899 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483ffe9-0e63-4177-a72d-ff8e2f25181b None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:57.722180 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483ffe9-0e63-4177-a72d-ff8e2f25181b None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:57.722449 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483ffe9-0e63-4177-a72d-ff8e2f25181b None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:57.723196 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483ffe9-0e63-4177-a72d-ff8e2f25181b None admin] RBAC: Adding query filter params (name=placement) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:57.723500 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483ffe9-0e63-4177-a72d-ff8e2f25181b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:57.724899 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483ffe9-0e63-4177-a72d-ff8e2f25181b None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:57.730597 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 455/920] 10.222.0.15 () {56 vars in 1116 bytes} [Fri Jun 24 17:16:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:57.738979 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba56ae-ee5a-430e-beaf-a42df9ad0bfb None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:57.775296 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:57.856838 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba56ae-ee5a-430e-beaf-a42df9ad0bfb None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:57.891756 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98558a-ec61-4e04-ab1b-b4afaf2466e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:57.892505 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98558a-ec61-4e04-ab1b-b4afaf2466e7 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:57.892784 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98558a-ec61-4e04-ab1b-b4afaf2466e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:57.893060 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98558a-ec61-4e04-ab1b-b4afaf2466e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:57.893865 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98558a-ec61-4e04-ab1b-b4afaf2466e7 None admin] RBAC: Adding query filter params (interface=public, service_id=37a061df47c1491da44e2f9d9d942fbe, region_id=RegionOne) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:16:57.894177 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98558a-ec61-4e04-ab1b-b4afaf2466e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:57.895579 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98558a-ec61-4e04-ab1b-b4afaf2466e7 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:57.900503 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 466/921] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Jun 24 17:16:57 2022] GET /identity/v3/endpoints?service_id=37a061df47c1491da44e2f9d9d942fbe&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:16:57.907112 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483ffe9-0e63-4177-a72d-ff8e2f25181b None admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:16:58.011467 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:16:58.030149 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483ffe9-0e63-4177-a72d-ff8e2f25181b None admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:16:58.071329 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa0f3f-8f5d-4d36-aecc-1d7deefce184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:16:58.071957 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa0f3f-8f5d-4d36-aecc-1d7deefce184 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:16:58.072231 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa0f3f-8f5d-4d36-aecc-1d7deefce184 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:16:58.072498 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa0f3f-8f5d-4d36-aecc-1d7deefce184 None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:16:58.073170 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa0f3f-8f5d-4d36-aecc-1d7deefce184 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:16:58.074548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa0f3f-8f5d-4d36-aecc-1d7deefce184 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:16:58.081225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 456/922] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Jun 24 17:16:57 2022] GET /identity/v3/services => generated 1962 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 17:17:00.326078 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff5deb-fa22-4d26-8493-dbb5ccbb5005 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:17:00.326916 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff5deb-fa22-4d26-8493-dbb5ccbb5005 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:17:00.326916 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff5deb-fa22-4d26-8493-dbb5ccbb5005 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:17:00.329159 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 467/923] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:17:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:17:00.337653 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d50d6-138e-4b2a-be74-c3fc01960390 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:17:00.338085 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d50d6-138e-4b2a-be74-c3fc01960390 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:17:00.338217 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d50d6-138e-4b2a-be74-c3fc01960390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:17:00.359715 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-940d50d6-138e-4b2a-be74-c3fc01960390 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:17:00.361021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-940d50d6-138e-4b2a-be74-c3fc01960390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:17:00.434142 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 457/924] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:17:00 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 17:17:00.458069 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff5deb-fa22-4d26-8493-dbb5ccbb5005 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:17:00.552510 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:17:00.563668 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff5deb-fa22-4d26-8493-dbb5ccbb5005 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:17:00.600238 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30788f9f-bc10-49f2-9eca-1118d33d74f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:17:00.600954 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30788f9f-bc10-49f2-9eca-1118d33d74f5 None admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:17:00.601229 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30788f9f-bc10-49f2-9eca-1118d33d74f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:17:00.601494 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30788f9f-bc10-49f2-9eca-1118d33d74f5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:17:00.602137 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30788f9f-bc10-49f2-9eca-1118d33d74f5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:17:00.603563 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30788f9f-bc10-49f2-9eca-1118d33d74f5 None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:17:00.617210 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application [None req-30788f9f-bc10-49f2-9eca-1118d33d74f5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 17:17:00.617210 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:17:00.617210 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 17:17:00.617210 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 17:17:00.617210 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 17:17:00.617210 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 17:17:00.617210 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 17:17:00.617210 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:17:00.617210 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 17:17:00.617210 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:17:00.617210 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 17:17:00.617210 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:17:00.617210 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 17:17:00.617210 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 17:17:00.617210 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 17:17:00.617210 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 17:17:00.617210 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 17:17:00.618335 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 17:17:00.618335 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 17:17:00.618335 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 17:17:00.618335 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 17:17:00.618335 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 17:17:00.618335 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 17:17:00.618335 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 17:17:00.618335 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 17:17:00.618335 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 17:17:00.618335 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 17:17:00.618335 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 17:17:00.618335 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 17:17:00.618335 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 17:17:00.618335 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 17:17:00.618335 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 17:17:00.618335 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 17:17:00.620950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 17:17:00.620950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application with Lock( Jun 24 17:17:00.620950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 17:17:00.620950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self._enter() Jun 24 17:17:00.620950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 17:17:00.620950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 17:17:00.620950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 17:17:00.620950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application return self.creator() Jun 24 17:17:00.620950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 17:17:00.620950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application created_value = creator( Jun 24 17:17:00.620950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 17:17:00.620950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 17:17:00.620950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 17:17:00.620950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: ERROR keystone.server.flask.application Jun 24 17:17:00.620950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 468/925] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Jun 24 17:17:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 17:17:00.627975 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d50d6-138e-4b2a-be74-c3fc01960390 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:17:00.713292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:17:00.736450 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d50d6-138e-4b2a-be74-c3fc01960390 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:17:00.770037 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9ad7a-2160-4302-8966-48e11cbf5b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:17:00.770714 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9ad7a-2160-4302-8966-48e11cbf5b65 None admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:17:00.770987 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9ad7a-2160-4302-8966-48e11cbf5b65 None admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:17:00.771251 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9ad7a-2160-4302-8966-48e11cbf5b65 None admin] PATH_INFO: `/v3/services` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:17:00.771944 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9ad7a-2160-4302-8966-48e11cbf5b65 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:17:00.772240 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9ad7a-2160-4302-8966-48e11cbf5b65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:17:00.773616 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9ad7a-2160-4302-8966-48e11cbf5b65 None admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:17:00.778598 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 458/926] 10.222.0.15 () {56 vars in 1116 bytes} [Fri Jun 24 17:17:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:17:00.785291 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30788f9f-bc10-49f2-9eca-1118d33d74f5 None admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:17:00.913715 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30788f9f-bc10-49f2-9eca-1118d33d74f5 None admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:17:00.954522 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aacb85-48d6-468b-b7b5-2f820ce1694e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:17:00.955260 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aacb85-48d6-468b-b7b5-2f820ce1694e None admin] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:17:00.955534 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aacb85-48d6-468b-b7b5-2f820ce1694e None admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:17:00.955839 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aacb85-48d6-468b-b7b5-2f820ce1694e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:17:00.956567 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aacb85-48d6-468b-b7b5-2f820ce1694e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:17:00.957945 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aacb85-48d6-468b-b7b5-2f820ce1694e None admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:17:00.985125 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 469/927] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Jun 24 17:17:00 2022] POST /identity/v3/endpoints => generated 331 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:17:10.776162 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=30 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:17:10.977473 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:18:01.045524 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28453c41-e3d1-4928-931d-b9bf5bd063f4 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:01.045524 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28453c41-e3d1-4928-931d-b9bf5bd063f4 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:01.045524 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28453c41-e3d1-4928-931d-b9bf5bd063f4 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:01.049863 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 459/928] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:18:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:18:01.052673 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38621b-0511-4798-8e55-7dca659d03c3 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:01.053138 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38621b-0511-4798-8e55-7dca659d03c3 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:01.053235 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38621b-0511-4798-8e55-7dca659d03c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:01.081317 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-1b38621b-0511-4798-8e55-7dca659d03c3 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:18:01.083336 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-1b38621b-0511-4798-8e55-7dca659d03c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:18:01.202599 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 470/929] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:18:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:18:01.242356 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4cfcd-ebc7-4dcf-909a-292585295ed6 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:01.243023 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4cfcd-ebc7-4dcf-909a-292585295ed6 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:01.243536 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4cfcd-ebc7-4dcf-909a-292585295ed6 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:01.245947 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 460/930] 10.222.0.15 () {54 vars in 964 bytes} [Fri Jun 24 17:18:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:18:01.252837 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549c390-e600-4953-a308-b706f350eaae None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:01.253129 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549c390-e600-4953-a308-b706f350eaae None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:01.253407 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549c390-e600-4953-a308-b706f350eaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:01.331394 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-e549c390-e600-4953-a308-b706f350eaae None None] MFA Rules not processed for user `f6385ebfadc74598b3b024408455842e`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:18:01.332614 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-e549c390-e600-4953-a308-b706f350eaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:18:01.429812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 471/931] 10.222.0.15 () {58 vars in 1061 bytes} [Fri Jun 24 17:18:01 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:18:01.438985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4cfcd-ebc7-4dcf-909a-292585295ed6 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:18:01.456417 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4cfcd-ebc7-4dcf-909a-292585295ed6 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:18:01.459984 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73721b1-e559-4345-a422-a3fe32c587c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:18:01.460629 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73721b1-e559-4345-a422-a3fe32c587c0 service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:01.460908 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73721b1-e559-4345-a422-a3fe32c587c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:01.461181 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73721b1-e559-4345-a422-a3fe32c587c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:01.471004 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73721b1-e559-4345-a422-a3fe32c587c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:18:01.472944 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73721b1-e559-4345-a422-a3fe32c587c0 service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:18:01.481940 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 461/932] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:18:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:18:04.046626 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b492135-9c34-49f8-8082-2b6f55c1eddd None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:04.047181 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b492135-9c34-49f8-8082-2b6f55c1eddd None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:04.047181 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b492135-9c34-49f8-8082-2b6f55c1eddd None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:04.048596 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 472/933] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:18:04.054430 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0534d-2ade-4b87-a18b-a5eff81b00e9 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:04.054982 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0534d-2ade-4b87-a18b-a5eff81b00e9 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:04.055060 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0534d-2ade-4b87-a18b-a5eff81b00e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:04.074999 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-84f0534d-2ade-4b87-a18b-a5eff81b00e9 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:18:04.076307 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-84f0534d-2ade-4b87-a18b-a5eff81b00e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:18:04.086624 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 462/934] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:18:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:18:04.141718 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1b583-6980-48d0-b4d1-8b7f0efbc453 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:04.142039 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1b583-6980-48d0-b4d1-8b7f0efbc453 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:04.142432 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1b583-6980-48d0-b4d1-8b7f0efbc453 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:04.143976 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 473/935] 10.222.0.15 () {54 vars in 964 bytes} [Fri Jun 24 17:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:18:04.150652 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703027b-0b83-45c9-b6e0-ecc3162602c4 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:04.150935 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703027b-0b83-45c9-b6e0-ecc3162602c4 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:04.151338 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703027b-0b83-45c9-b6e0-ecc3162602c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:04.170594 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-9703027b-0b83-45c9-b6e0-ecc3162602c4 None None] MFA Rules not processed for user `f6385ebfadc74598b3b024408455842e`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:18:04.171814 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-9703027b-0b83-45c9-b6e0-ecc3162602c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:18:04.178640 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 463/936] 10.222.0.15 () {58 vars in 1061 bytes} [Fri Jun 24 17:18:04 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:18:04.187800 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1b583-6980-48d0-b4d1-8b7f0efbc453 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:18:04.199621 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1b583-6980-48d0-b4d1-8b7f0efbc453 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:18:04.203714 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd08d3d-a6fa-45ad-905f-cf6b712d3f3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:18:04.204371 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd08d3d-a6fa-45ad-905f-cf6b712d3f3e service neutron] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:04.204647 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd08d3d-a6fa-45ad-905f-cf6b712d3f3e service neutron] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:04.204916 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd08d3d-a6fa-45ad-905f-cf6b712d3f3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:04.215479 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd08d3d-a6fa-45ad-905f-cf6b712d3f3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:18:04.217065 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd08d3d-a6fa-45ad-905f-cf6b712d3f3e service neutron] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:18:04.228445 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 474/937] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:18:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:18:07.073110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a46dc-6593-4483-ba2e-03cb12c6dd8e None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:07.073696 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a46dc-6593-4483-ba2e-03cb12c6dd8e None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:07.073696 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a46dc-6593-4483-ba2e-03cb12c6dd8e None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:07.075094 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 464/938] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:18:07.080786 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2bb61-152b-4a0b-81ad-41eba3c5c576 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:07.081194 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2bb61-152b-4a0b-81ad-41eba3c5c576 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:07.081456 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2bb61-152b-4a0b-81ad-41eba3c5c576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:07.118999 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-4ed2bb61-152b-4a0b-81ad-41eba3c5c576 None None] MFA Rules not processed for user `3d76b2e90106415987b2b47fc32218a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:18:07.120186 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-4ed2bb61-152b-4a0b-81ad-41eba3c5c576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:18:07.162757 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:18:07.192074 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 475/939] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:18:07 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 17:18:07.232390 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a46dc-6593-4483-ba2e-03cb12c6dd8e None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:18:07.245076 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a46dc-6593-4483-ba2e-03cb12c6dd8e None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:18:07.249495 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c24fc8-dc23-4658-896f-76d4f09bb7a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:18:07.250338 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c24fc8-dc23-4658-896f-76d4f09bb7a7 service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:07.250738 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c24fc8-dc23-4658-896f-76d4f09bb7a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:07.251008 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c24fc8-dc23-4658-896f-76d4f09bb7a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:07.261942 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c24fc8-dc23-4658-896f-76d4f09bb7a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:18:07.263508 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c24fc8-dc23-4658-896f-76d4f09bb7a7 service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:18:07.273339 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 465/940] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:18:07 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:18:10.255882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cd149-7feb-4570-8ee5-854203686f80 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:10.256758 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cd149-7feb-4570-8ee5-854203686f80 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:10.256758 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cd149-7feb-4570-8ee5-854203686f80 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:10.258980 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 476/941] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:18:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:18:10.265692 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd060b34-0ef3-4ca3-b41e-466c2bfed494 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:10.266368 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd060b34-0ef3-4ca3-b41e-466c2bfed494 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:10.266638 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd060b34-0ef3-4ca3-b41e-466c2bfed494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:10.290072 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-cd060b34-0ef3-4ca3-b41e-466c2bfed494 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:18:10.291235 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-cd060b34-0ef3-4ca3-b41e-466c2bfed494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:18:10.373065 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 466/942] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:18:10 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:18:10.413062 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cd149-7feb-4570-8ee5-854203686f80 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:18:10.425741 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cd149-7feb-4570-8ee5-854203686f80 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:18:10.430860 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e91dc-ff99-485e-ae23-4c4dad218475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:18:10.431495 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e91dc-ff99-485e-ae23-4c4dad218475 service neutron] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:10.431780 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e91dc-ff99-485e-ae23-4c4dad218475 service neutron] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:10.432041 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e91dc-ff99-485e-ae23-4c4dad218475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:10.441847 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e91dc-ff99-485e-ae23-4c4dad218475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:18:10.443324 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e91dc-ff99-485e-ae23-4c4dad218475 service neutron] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:18:10.453043 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 477/943] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:18:10 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:18:13.453776 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904d232-305f-46bf-998c-729e5521dca1 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:13.454366 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904d232-305f-46bf-998c-729e5521dca1 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:13.454366 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904d232-305f-46bf-998c-729e5521dca1 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:13.456240 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 467/944] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:18:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:18:13.461543 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee203c8-867e-4ef8-92a5-41c7c9a437b0 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:13.461995 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee203c8-867e-4ef8-92a5-41c7c9a437b0 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:13.464655 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee203c8-867e-4ef8-92a5-41c7c9a437b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:13.483881 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-3ee203c8-867e-4ef8-92a5-41c7c9a437b0 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:18:13.485130 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-3ee203c8-867e-4ef8-92a5-41c7c9a437b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:18:13.501695 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 478/945] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:18:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:18:13.530396 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904d232-305f-46bf-998c-729e5521dca1 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:18:13.542597 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904d232-305f-46bf-998c-729e5521dca1 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:18:13.546056 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65cf01-22ee-4a46-b511-331de0ccbe97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:18:13.546779 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65cf01-22ee-4a46-b511-331de0ccbe97 service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:13.547064 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65cf01-22ee-4a46-b511-331de0ccbe97 service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:13.547336 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65cf01-22ee-4a46-b511-331de0ccbe97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:13.556698 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65cf01-22ee-4a46-b511-331de0ccbe97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:18:13.558142 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65cf01-22ee-4a46-b511-331de0ccbe97 service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:18:13.575946 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 468/946] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:18:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:18:15.917667 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd144c-95c9-4d6f-9e50-74c2121f31fc None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:15.918234 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd144c-95c9-4d6f-9e50-74c2121f31fc None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:15.918234 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd144c-95c9-4d6f-9e50-74c2121f31fc None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:15.919736 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 479/947] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:18:15.925436 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ff94c-424f-41af-a8c6-b2f386f09ed1 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:15.925886 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ff94c-424f-41af-a8c6-b2f386f09ed1 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:15.925992 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ff94c-424f-41af-a8c6-b2f386f09ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:15.944504 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-bc9ff94c-424f-41af-a8c6-b2f386f09ed1 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:18:15.945785 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-bc9ff94c-424f-41af-a8c6-b2f386f09ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:18:15.954502 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 469/948] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:18:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:18:15.991076 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd144c-95c9-4d6f-9e50-74c2121f31fc None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:18:16.003493 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd144c-95c9-4d6f-9e50-74c2121f31fc None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:18:16.008240 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6379d5-080a-4f87-82c4-95086124fbf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:18:16.008882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6379d5-080a-4f87-82c4-95086124fbf1 service neutron] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:16.009179 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6379d5-080a-4f87-82c4-95086124fbf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:16.009710 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6379d5-080a-4f87-82c4-95086124fbf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:16.022034 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6379d5-080a-4f87-82c4-95086124fbf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:18:16.022034 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6379d5-080a-4f87-82c4-95086124fbf1 service neutron] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:18:16.031569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 480/949] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:18:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:18:18.351199 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f824ba3-f89a-498e-99cb-5ab6edbe3b6a None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:18.351721 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f824ba3-f89a-498e-99cb-5ab6edbe3b6a None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:18.351721 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f824ba3-f89a-498e-99cb-5ab6edbe3b6a None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:18.352998 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 470/950] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:18:18.358178 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab62ae6-b62f-4095-bd1d-c3ae783eb901 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:18.358670 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab62ae6-b62f-4095-bd1d-c3ae783eb901 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:18.358780 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab62ae6-b62f-4095-bd1d-c3ae783eb901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:18.377715 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-3ab62ae6-b62f-4095-bd1d-c3ae783eb901 None None] MFA Rules not processed for user `3d76b2e90106415987b2b47fc32218a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:18:18.378975 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-3ab62ae6-b62f-4095-bd1d-c3ae783eb901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:18:18.387461 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 481/951] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:18:18 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:18:18.425617 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f824ba3-f89a-498e-99cb-5ab6edbe3b6a None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:18:18.437683 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f824ba3-f89a-498e-99cb-5ab6edbe3b6a None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:18:18.442525 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bdbfe-294c-477c-be5b-a40c2941b99f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:18:18.443412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bdbfe-294c-477c-be5b-a40c2941b99f service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:18.443688 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bdbfe-294c-477c-be5b-a40c2941b99f service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:18.443960 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bdbfe-294c-477c-be5b-a40c2941b99f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:18.454120 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bdbfe-294c-477c-be5b-a40c2941b99f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:18:18.455659 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bdbfe-294c-477c-be5b-a40c2941b99f service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:18:18.465714 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 471/952] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:18:18 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:18:21.001793 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6abc5-640c-4584-b6ae-1cee10b45689 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:21.002354 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6abc5-640c-4584-b6ae-1cee10b45689 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:21.002354 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6abc5-640c-4584-b6ae-1cee10b45689 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:21.003818 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 482/953] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:18:21.009746 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbca869-8bdb-46c5-8679-465b32e176c7 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:21.010270 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbca869-8bdb-46c5-8679-465b32e176c7 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:21.010270 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbca869-8bdb-46c5-8679-465b32e176c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:21.030398 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-1dbca869-8bdb-46c5-8679-465b32e176c7 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:18:21.031735 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-1dbca869-8bdb-46c5-8679-465b32e176c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:18:21.040748 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 472/954] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:18:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:18:21.080906 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6abc5-640c-4584-b6ae-1cee10b45689 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:18:21.093807 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6abc5-640c-4584-b6ae-1cee10b45689 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:18:21.097426 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f64fda-cdf6-4aef-98ab-9b4a23fdcdf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:18:21.098086 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f64fda-cdf6-4aef-98ab-9b4a23fdcdf8 service neutron] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:21.098360 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f64fda-cdf6-4aef-98ab-9b4a23fdcdf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:21.098657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f64fda-cdf6-4aef-98ab-9b4a23fdcdf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:21.108456 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f64fda-cdf6-4aef-98ab-9b4a23fdcdf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:18:21.109912 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f64fda-cdf6-4aef-98ab-9b4a23fdcdf8 service neutron] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:18:21.121073 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 483/955] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:18:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:18:23.493059 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d129b-8605-4fa9-b51c-87f513478a25 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:23.493581 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d129b-8605-4fa9-b51c-87f513478a25 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:23.493581 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d129b-8605-4fa9-b51c-87f513478a25 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:23.495022 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 473/956] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:18:23.500562 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0e837-46a1-4a1d-80f9-07b521b4d815 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:23.501005 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0e837-46a1-4a1d-80f9-07b521b4d815 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:23.501214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0e837-46a1-4a1d-80f9-07b521b4d815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:23.520816 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-91f0e837-46a1-4a1d-80f9-07b521b4d815 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:18:23.522078 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-91f0e837-46a1-4a1d-80f9-07b521b4d815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:18:23.531271 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 484/957] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:18:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:18:23.572416 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d129b-8605-4fa9-b51c-87f513478a25 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:18:23.584736 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d129b-8605-4fa9-b51c-87f513478a25 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:18:23.588770 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d553ec-3a81-4236-b03c-9f1547306b93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:18:23.589409 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d553ec-3a81-4236-b03c-9f1547306b93 service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:23.589684 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d553ec-3a81-4236-b03c-9f1547306b93 service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:23.590010 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d553ec-3a81-4236-b03c-9f1547306b93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:23.599278 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d553ec-3a81-4236-b03c-9f1547306b93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:18:23.600713 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d553ec-3a81-4236-b03c-9f1547306b93 service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:18:23.610355 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 474/958] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:18:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:18:26.204091 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14badbbb-93a4-4934-97a8-f7d37d3e34d9 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:26.204964 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14badbbb-93a4-4934-97a8-f7d37d3e34d9 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:26.205106 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14badbbb-93a4-4934-97a8-f7d37d3e34d9 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:26.207293 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 485/959] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:18:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:18:26.212952 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a3c69-e96c-49ff-8c7d-92512d336431 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:26.213449 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a3c69-e96c-49ff-8c7d-92512d336431 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:26.213550 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a3c69-e96c-49ff-8c7d-92512d336431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:26.234983 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-0f1a3c69-e96c-49ff-8c7d-92512d336431 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:18:26.236774 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-0f1a3c69-e96c-49ff-8c7d-92512d336431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:18:26.251432 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 475/960] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:18:26 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:18:26.291066 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14badbbb-93a4-4934-97a8-f7d37d3e34d9 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:18:26.303605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14badbbb-93a4-4934-97a8-f7d37d3e34d9 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:18:26.307562 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92aed82-c88f-4de9-bd5b-bca19ceb6272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:18:26.308183 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92aed82-c88f-4de9-bd5b-bca19ceb6272 service neutron] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:26.308454 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92aed82-c88f-4de9-bd5b-bca19ceb6272 service neutron] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:26.308704 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92aed82-c88f-4de9-bd5b-bca19ceb6272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:26.318772 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92aed82-c88f-4de9-bd5b-bca19ceb6272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:18:26.320225 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92aed82-c88f-4de9-bd5b-bca19ceb6272 service neutron] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:18:26.330071 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 486/961] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:18:26 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:18:30.741529 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0a253-e50d-4fb0-bcdd-0097073a1193 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:30.742110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0a253-e50d-4fb0-bcdd-0097073a1193 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:30.742110 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0a253-e50d-4fb0-bcdd-0097073a1193 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:30.743504 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 476/962] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:18:30.748927 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f56df-8f1e-47c6-8ec0-257a00fd57b3 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:30.749409 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f56df-8f1e-47c6-8ec0-257a00fd57b3 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:30.749580 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f56df-8f1e-47c6-8ec0-257a00fd57b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:30.768583 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-811f56df-8f1e-47c6-8ec0-257a00fd57b3 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:18:30.770328 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-811f56df-8f1e-47c6-8ec0-257a00fd57b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:18:30.779732 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 487/963] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:18:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 17:18:30.819381 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0a253-e50d-4fb0-bcdd-0097073a1193 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:18:30.825017 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=77 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:18:30.831211 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0a253-e50d-4fb0-bcdd-0097073a1193 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:18:30.834869 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689be5a0-c163-4bda-b23d-ec6f845f3440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:18:30.835509 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689be5a0-c163-4bda-b23d-ec6f845f3440 service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:30.835780 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689be5a0-c163-4bda-b23d-ec6f845f3440 service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:30.836048 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689be5a0-c163-4bda-b23d-ec6f845f3440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:30.845103 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689be5a0-c163-4bda-b23d-ec6f845f3440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:18:30.846538 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689be5a0-c163-4bda-b23d-ec6f845f3440 service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:18:30.855816 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 477/964] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:18:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:18:33.777200 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05e283-1ad2-4294-9ee3-41c028763bd8 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:33.777745 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05e283-1ad2-4294-9ee3-41c028763bd8 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:33.777745 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05e283-1ad2-4294-9ee3-41c028763bd8 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:33.779185 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 488/965] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:18:33.784712 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeed876-2340-40ac-b1aa-504c59ec9660 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:33.785091 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeed876-2340-40ac-b1aa-504c59ec9660 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:33.785365 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeed876-2340-40ac-b1aa-504c59ec9660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:33.804009 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-0aeed876-2340-40ac-b1aa-504c59ec9660 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:18:33.805204 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-0aeed876-2340-40ac-b1aa-504c59ec9660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:18:33.813571 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 478/966] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:18:33 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:18:33.852703 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05e283-1ad2-4294-9ee3-41c028763bd8 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:18:33.865476 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05e283-1ad2-4294-9ee3-41c028763bd8 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:18:33.869675 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d6ebd-a0c8-4c7a-b7f5-a492649e8947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:18:33.870311 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d6ebd-a0c8-4c7a-b7f5-a492649e8947 service neutron] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:33.870605 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d6ebd-a0c8-4c7a-b7f5-a492649e8947 service neutron] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:33.870895 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d6ebd-a0c8-4c7a-b7f5-a492649e8947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:33.880964 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d6ebd-a0c8-4c7a-b7f5-a492649e8947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:18:33.882420 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d6ebd-a0c8-4c7a-b7f5-a492649e8947 service neutron] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:18:33.892088 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 489/967] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:18:33 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:18:38.650657 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a7b79-c87b-4c25-b8a4-56d0b233cc82 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:38.651191 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a7b79-c87b-4c25-b8a4-56d0b233cc82 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:38.651191 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a7b79-c87b-4c25-b8a4-56d0b233cc82 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:38.652496 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 479/968] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:18:38.657975 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de1c2c-1587-468c-bd4f-0b72d3aa3069 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:38.660654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de1c2c-1587-468c-bd4f-0b72d3aa3069 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:38.661257 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de1c2c-1587-468c-bd4f-0b72d3aa3069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:38.672068 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=54 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:18:38.694407 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-b6de1c2c-1587-468c-bd4f-0b72d3aa3069 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:18:38.695692 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-b6de1c2c-1587-468c-bd4f-0b72d3aa3069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:18:38.704699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 490/969] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:18:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:18:38.743429 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a7b79-c87b-4c25-b8a4-56d0b233cc82 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:18:38.755948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a7b79-c87b-4c25-b8a4-56d0b233cc82 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:18:38.759903 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2de45f-278d-413d-96fa-736a53eb22d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:18:38.760637 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2de45f-278d-413d-96fa-736a53eb22d1 service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:38.760982 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2de45f-278d-413d-96fa-736a53eb22d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:38.761336 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2de45f-278d-413d-96fa-736a53eb22d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:38.771567 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2de45f-278d-413d-96fa-736a53eb22d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:18:38.773016 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2de45f-278d-413d-96fa-736a53eb22d1 service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:18:38.782940 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 480/970] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:18:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:18:44.158456 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636be70-060e-494a-adcf-bc465623ece2 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:44.158958 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636be70-060e-494a-adcf-bc465623ece2 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:44.158958 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636be70-060e-494a-adcf-bc465623ece2 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:44.160717 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 491/971] 10.222.0.15 () {54 vars in 921 bytes} [Fri Jun 24 17:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:18:44.165908 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c74d7b-c4ef-4677-b3ec-4a6e0467f987 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:44.166732 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c74d7b-c4ef-4677-b3ec-4a6e0467f987 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:44.167170 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c74d7b-c4ef-4677-b3ec-4a6e0467f987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:44.239311 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-24c74d7b-c4ef-4677-b3ec-4a6e0467f987 None None] MFA Rules not processed for user `b318b7cfb1c5485cba96997ddd73945c`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:18:44.240464 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-24c74d7b-c4ef-4677-b3ec-4a6e0467f987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:18:44.356055 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 481/972] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Jun 24 17:18:44 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:18:48.685566 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=2 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:18:48.979094 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1b9d8-3e0c-4266-a745-827e02106bb7 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:48.979480 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1b9d8-3e0c-4266-a745-827e02106bb7 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:48.979705 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1b9d8-3e0c-4266-a745-827e02106bb7 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:48.981010 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 492/973] 10.222.0.15 () {54 vars in 921 bytes} [Fri Jun 24 17:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:18:48.986425 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca6269-4ea6-4a9b-aa5f-a0ebf94fbda2 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:48.987468 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca6269-4ea6-4a9b-aa5f-a0ebf94fbda2 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:48.987957 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca6269-4ea6-4a9b-aa5f-a0ebf94fbda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:49.013251 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-98ca6269-4ea6-4a9b-aa5f-a0ebf94fbda2 None None] MFA Rules not processed for user `b318b7cfb1c5485cba96997ddd73945c`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:18:49.015364 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-98ca6269-4ea6-4a9b-aa5f-a0ebf94fbda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:18:49.028215 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 482/974] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Jun 24 17:18:48 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:18:50.564674 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c77369-3e5a-4cbc-9e8c-8f94c066e4ce None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:50.565239 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c77369-3e5a-4cbc-9e8c-8f94c066e4ce None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:50.565239 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c77369-3e5a-4cbc-9e8c-8f94c066e4ce None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:50.566541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 493/975] 10.222.0.15 () {54 vars in 921 bytes} [Fri Jun 24 17:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:18:50.571683 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73a04-eb6a-46ca-be36-862c9b7e5138 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:50.572123 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73a04-eb6a-46ca-be36-862c9b7e5138 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:50.572216 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73a04-eb6a-46ca-be36-862c9b7e5138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:50.591194 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-02f73a04-eb6a-46ca-be36-862c9b7e5138 None None] MFA Rules not processed for user `b318b7cfb1c5485cba96997ddd73945c`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:18:50.592378 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-02f73a04-eb6a-46ca-be36-862c9b7e5138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:18:50.602787 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 483/976] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Jun 24 17:18:50 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:18:54.527005 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92016ecf-5919-4e5e-b417-08ed77ead17b None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:54.527900 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92016ecf-5919-4e5e-b417-08ed77ead17b None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:54.528440 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92016ecf-5919-4e5e-b417-08ed77ead17b None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:54.529952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 494/977] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:18:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:18:54.535587 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b88df-a7bf-482d-9f17-6daf26920307 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:54.536010 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b88df-a7bf-482d-9f17-6daf26920307 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:54.536010 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b88df-a7bf-482d-9f17-6daf26920307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:54.554661 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-5c1b88df-a7bf-482d-9f17-6daf26920307 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:18:54.556436 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-5c1b88df-a7bf-482d-9f17-6daf26920307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:18:54.574998 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 484/978] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:18:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:18:54.619851 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d74cbf-083e-475e-ab38-310084c05d73 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:54.620508 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d74cbf-083e-475e-ab38-310084c05d73 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:54.621030 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d74cbf-083e-475e-ab38-310084c05d73 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:54.622995 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 495/979] 10.222.0.15 () {54 vars in 961 bytes} [Fri Jun 24 17:18:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:18:54.631917 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a886e-3e97-4fee-932c-006afb1bf484 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:54.632494 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a886e-3e97-4fee-932c-006afb1bf484 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:54.633134 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a886e-3e97-4fee-932c-006afb1bf484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:54.673551 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-f77a886e-3e97-4fee-932c-006afb1bf484 None None] MFA Rules not processed for user `9ff8200a750d49b1830c58f279e569c3`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:18:54.675127 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-f77a886e-3e97-4fee-932c-006afb1bf484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:18:54.742505 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:18:54.748404 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 485/980] 10.222.0.15 () {58 vars in 1058 bytes} [Fri Jun 24 17:18:54 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 17:18:54.757611 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d74cbf-083e-475e-ab38-310084c05d73 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:18:54.772799 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d74cbf-083e-475e-ab38-310084c05d73 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:18:54.778363 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301691af-a33c-4fa2-939f-bc53dcd961df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:18:54.779099 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301691af-a33c-4fa2-939f-bc53dcd961df service nova] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:54.779381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301691af-a33c-4fa2-939f-bc53dcd961df service nova] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:54.779653 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301691af-a33c-4fa2-939f-bc53dcd961df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:54.787994 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301691af-a33c-4fa2-939f-bc53dcd961df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:18:54.789908 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301691af-a33c-4fa2-939f-bc53dcd961df service nova] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:18:54.800097 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 496/981] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:18:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:18:57.399107 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071dbb6-dff1-42fe-b666-4c3bf962838e None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:57.399708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071dbb6-dff1-42fe-b666-4c3bf962838e None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:57.399708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071dbb6-dff1-42fe-b666-4c3bf962838e None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:57.402133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 486/982] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:18:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:18:57.406717 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfac33-aa2c-487c-9d2c-409ca9875c24 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:57.407148 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfac33-aa2c-487c-9d2c-409ca9875c24 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:57.407229 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfac33-aa2c-487c-9d2c-409ca9875c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:57.426064 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-dadfac33-aa2c-487c-9d2c-409ca9875c24 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:18:57.427525 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-dadfac33-aa2c-487c-9d2c-409ca9875c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:18:57.436412 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 497/983] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:18:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:18:57.483172 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071dbb6-dff1-42fe-b666-4c3bf962838e None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:18:57.496906 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071dbb6-dff1-42fe-b666-4c3bf962838e None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:18:57.501755 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68998571-c553-4663-88c6-afd6f9f5ddb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:18:57.502393 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68998571-c553-4663-88c6-afd6f9f5ddb4 service nova] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:18:57.502708 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68998571-c553-4663-88c6-afd6f9f5ddb4 service nova] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:18:57.502981 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68998571-c553-4663-88c6-afd6f9f5ddb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:18:57.512042 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68998571-c553-4663-88c6-afd6f9f5ddb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:18:57.513630 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68998571-c553-4663-88c6-afd6f9f5ddb4 service nova] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:18:57.523643 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 487/984] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:18:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:00.128256 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0b516-ab51-41d1-99dd-a414572ad8a7 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:00.128792 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0b516-ab51-41d1-99dd-a414572ad8a7 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:00.128792 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0b516-ab51-41d1-99dd-a414572ad8a7 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:00.130169 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 498/985] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:00.135417 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20485611-ebe9-4e9e-913e-8351924044e4 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:00.135831 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20485611-ebe9-4e9e-913e-8351924044e4 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:00.135922 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20485611-ebe9-4e9e-913e-8351924044e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:00.155666 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-20485611-ebe9-4e9e-913e-8351924044e4 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:00.157085 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-20485611-ebe9-4e9e-913e-8351924044e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:00.165971 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 488/986] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:19:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:00.216391 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62749f66-f60f-49a9-a04c-9237249912dd None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:00.216775 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62749f66-f60f-49a9-a04c-9237249912dd None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:00.217050 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62749f66-f60f-49a9-a04c-9237249912dd None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:00.218416 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 499/987] 10.222.0.15 () {54 vars in 961 bytes} [Fri Jun 24 17:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:00.223780 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb123b1-fd42-486e-a509-e87a83124e5a None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:00.224059 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb123b1-fd42-486e-a509-e87a83124e5a None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:00.224331 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb123b1-fd42-486e-a509-e87a83124e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:00.242957 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-cfb123b1-fd42-486e-a509-e87a83124e5a None None] MFA Rules not processed for user `9ff8200a750d49b1830c58f279e569c3`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:00.244488 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-cfb123b1-fd42-486e-a509-e87a83124e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:00.253232 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 489/988] 10.222.0.15 () {58 vars in 1058 bytes} [Fri Jun 24 17:19:00 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:00.261031 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62749f66-f60f-49a9-a04c-9237249912dd None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:00.275808 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62749f66-f60f-49a9-a04c-9237249912dd None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:00.280919 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d22c5-4134-462d-ac92-d97016cb78e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:00.281488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d22c5-4134-462d-ac92-d97016cb78e3 service nova] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:00.281758 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d22c5-4134-462d-ac92-d97016cb78e3 service nova] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:00.282072 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d22c5-4134-462d-ac92-d97016cb78e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:00.290387 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d22c5-4134-462d-ac92-d97016cb78e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:00.292533 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d22c5-4134-462d-ac92-d97016cb78e3 service nova] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:00.302657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 500/989] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:02.719318 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc408a33-036d-47f8-bd47-3dd6faf208f5 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:02.720211 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc408a33-036d-47f8-bd47-3dd6faf208f5 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:02.720640 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc408a33-036d-47f8-bd47-3dd6faf208f5 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:02.722411 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 490/990] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:19:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:02.728051 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c7c05-13ae-4e81-af6b-cfdb71815ef7 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:02.729129 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c7c05-13ae-4e81-af6b-cfdb71815ef7 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:02.729547 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c7c05-13ae-4e81-af6b-cfdb71815ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:02.762020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-774c7c05-13ae-4e81-af6b-cfdb71815ef7 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:02.764013 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-774c7c05-13ae-4e81-af6b-cfdb71815ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:02.773070 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 501/991] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:19:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:02.821890 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc408a33-036d-47f8-bd47-3dd6faf208f5 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:02.844704 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc408a33-036d-47f8-bd47-3dd6faf208f5 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:02.850278 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc0ff0-659b-497d-86c6-d79e0de1c430 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:02.851114 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc0ff0-659b-497d-86c6-d79e0de1c430 service nova] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:02.851645 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc0ff0-659b-497d-86c6-d79e0de1c430 service nova] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:02.852117 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc0ff0-659b-497d-86c6-d79e0de1c430 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:02.862197 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc0ff0-659b-497d-86c6-d79e0de1c430 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:02.864336 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc0ff0-659b-497d-86c6-d79e0de1c430 service nova] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:02.889479 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 491/992] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:04.668986 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144a136-126e-46fd-a628-c9064579e742 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:04.669459 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144a136-126e-46fd-a628-c9064579e742 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:04.669559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144a136-126e-46fd-a628-c9064579e742 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:04.671356 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 502/993] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:04.681482 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aad8f0-5967-41e7-a590-def9c4931d4a None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:04.682015 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aad8f0-5967-41e7-a590-def9c4931d4a None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:04.682153 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aad8f0-5967-41e7-a590-def9c4931d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:04.705287 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-11aad8f0-5967-41e7-a590-def9c4931d4a None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:04.707159 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-11aad8f0-5967-41e7-a590-def9c4931d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:04.715753 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 492/994] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:19:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:05.053158 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ca3f7-0ccb-46aa-9675-884e2f3be673 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:05.053435 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ca3f7-0ccb-46aa-9675-884e2f3be673 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:05.053896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ca3f7-0ccb-46aa-9675-884e2f3be673 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:05.055609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 503/995] 10.222.0.15 () {54 vars in 963 bytes} [Fri Jun 24 17:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 17:19:05.061313 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51823498-fbd9-4222-925c-65761c9f2f81 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:05.061668 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51823498-fbd9-4222-925c-65761c9f2f81 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:05.061877 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51823498-fbd9-4222-925c-65761c9f2f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:05.105479 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-51823498-fbd9-4222-925c-65761c9f2f81 None None] MFA Rules not processed for user `aa7e8d98fb4744b7af95aa93050318d4`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:05.106896 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-51823498-fbd9-4222-925c-65761c9f2f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:05.172552 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 493/996] 10.222.0.15 () {58 vars in 1060 bytes} [Fri Jun 24 17:19:05 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:05.180438 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ca3f7-0ccb-46aa-9675-884e2f3be673 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:05.193121 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ca3f7-0ccb-46aa-9675-884e2f3be673 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:05.196876 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7044fd-88f8-4432-b5c2-52413760b698 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa7e8d98fb4744b7af95aa93050318d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:05.197550 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7044fd-88f8-4432-b5c2-52413760b698 service cinder] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:05.198004 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7044fd-88f8-4432-b5c2-52413760b698 service cinder] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:05.198398 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7044fd-88f8-4432-b5c2-52413760b698 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:05.209049 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7044fd-88f8-4432-b5c2-52413760b698 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:05.210521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7044fd-88f8-4432-b5c2-52413760b698 service cinder] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:05.221431 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 504/997] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:05.428161 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf6f43-7fbc-4af8-be96-b15cd6b1a3a8 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:05.428522 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf6f43-7fbc-4af8-be96-b15cd6b1a3a8 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:05.428724 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf6f43-7fbc-4af8-be96-b15cd6b1a3a8 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:05.430273 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 494/998] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:05.435614 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22ca69-947a-4673-88d3-89f5174f2167 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:05.435873 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22ca69-947a-4673-88d3-89f5174f2167 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:05.436351 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22ca69-947a-4673-88d3-89f5174f2167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:05.455119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-bb22ca69-947a-4673-88d3-89f5174f2167 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:05.456337 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-bb22ca69-947a-4673-88d3-89f5174f2167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:05.465084 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 505/999] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:19:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:05.511415 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf6f43-7fbc-4af8-be96-b15cd6b1a3a8 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:05.525475 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf6f43-7fbc-4af8-be96-b15cd6b1a3a8 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:05.530613 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92e569-0d6e-49a0-89de-773e06dd1ff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:05.531426 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92e569-0d6e-49a0-89de-773e06dd1ff2 service nova] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:05.531863 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92e569-0d6e-49a0-89de-773e06dd1ff2 service nova] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:05.532274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92e569-0d6e-49a0-89de-773e06dd1ff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:05.543197 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92e569-0d6e-49a0-89de-773e06dd1ff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:05.545057 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92e569-0d6e-49a0-89de-773e06dd1ff2 service nova] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:05.556051 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 495/1000] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:07.940674 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7a913-ed31-475b-9986-8495169a10b1 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:07.941258 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7a913-ed31-475b-9986-8495169a10b1 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:07.941258 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7a913-ed31-475b-9986-8495169a10b1 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:07.942604 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 506/1001] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:07.948037 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690ad72-efa6-4352-a3b7-b50c3cda07de None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:07.948732 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690ad72-efa6-4352-a3b7-b50c3cda07de None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:07.948732 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690ad72-efa6-4352-a3b7-b50c3cda07de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:07.969262 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-d690ad72-efa6-4352-a3b7-b50c3cda07de None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:07.970479 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-d690ad72-efa6-4352-a3b7-b50c3cda07de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:07.979647 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 496/1002] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:19:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:08.029335 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7a913-ed31-475b-9986-8495169a10b1 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:08.043438 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7a913-ed31-475b-9986-8495169a10b1 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:08.048328 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6b396-82d3-4e6e-a361-4faa4a5b82f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:08.048979 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6b396-82d3-4e6e-a361-4faa4a5b82f1 service nova] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:08.049257 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6b396-82d3-4e6e-a361-4faa4a5b82f1 service nova] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:08.049527 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6b396-82d3-4e6e-a361-4faa4a5b82f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:08.058339 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6b396-82d3-4e6e-a361-4faa4a5b82f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:08.059964 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6b396-82d3-4e6e-a361-4faa4a5b82f1 service nova] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:08.069110 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 507/1003] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:10.461702 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08d6a9-bb3c-41dc-ae4a-73f1dbdedeee None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:10.462269 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08d6a9-bb3c-41dc-ae4a-73f1dbdedeee None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:10.462269 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08d6a9-bb3c-41dc-ae4a-73f1dbdedeee None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:10.464142 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 497/1004] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:19:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:10.469258 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e7cd6-aafc-475f-8767-619ff0d77f20 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:10.469753 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e7cd6-aafc-475f-8767-619ff0d77f20 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:10.469753 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e7cd6-aafc-475f-8767-619ff0d77f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:10.488654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-5a3e7cd6-aafc-475f-8767-619ff0d77f20 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:10.489844 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-5a3e7cd6-aafc-475f-8767-619ff0d77f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:10.498548 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 508/1005] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:19:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:10.541203 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08d6a9-bb3c-41dc-ae4a-73f1dbdedeee None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:10.557522 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08d6a9-bb3c-41dc-ae4a-73f1dbdedeee None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:10.562670 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4098b-857d-4a64-ad36-09d84211af73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:10.563412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4098b-857d-4a64-ad36-09d84211af73 service nova] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:10.563768 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4098b-857d-4a64-ad36-09d84211af73 service nova] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:10.564109 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4098b-857d-4a64-ad36-09d84211af73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:10.572499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4098b-857d-4a64-ad36-09d84211af73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:10.574165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4098b-857d-4a64-ad36-09d84211af73 service nova] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:10.584073 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 498/1006] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:12.914803 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0000d-b03c-4c82-8d5b-444d29463481 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:12.915458 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0000d-b03c-4c82-8d5b-444d29463481 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:12.915458 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0000d-b03c-4c82-8d5b-444d29463481 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:12.916748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 509/1007] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:12.923416 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937fa91-6eca-40ac-9979-3ecb523ada34 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:12.924061 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937fa91-6eca-40ac-9979-3ecb523ada34 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:12.924061 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937fa91-6eca-40ac-9979-3ecb523ada34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:12.943826 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-d937fa91-6eca-40ac-9979-3ecb523ada34 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:12.945014 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-d937fa91-6eca-40ac-9979-3ecb523ada34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:12.953436 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 499/1008] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:19:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 17:19:12.998306 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0000d-b03c-4c82-8d5b-444d29463481 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:13.012905 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0000d-b03c-4c82-8d5b-444d29463481 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:13.018032 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c28774-c136-4237-85bf-067c093f10d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:13.018785 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c28774-c136-4237-85bf-067c093f10d7 service nova] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:13.019131 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c28774-c136-4237-85bf-067c093f10d7 service nova] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:13.019467 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c28774-c136-4237-85bf-067c093f10d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:13.037712 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c28774-c136-4237-85bf-067c093f10d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:13.039443 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c28774-c136-4237-85bf-067c093f10d7 service nova] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:13.049978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 510/1009] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:16.071770 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76faa158-60f0-45f3-bbcf-7e459636310a None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:16.072453 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76faa158-60f0-45f3-bbcf-7e459636310a None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:16.072453 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76faa158-60f0-45f3-bbcf-7e459636310a None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:16.073822 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 500/1010] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:16.080023 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062d778-3753-4d6e-b813-3e51d76699f4 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:16.080698 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062d778-3753-4d6e-b813-3e51d76699f4 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:16.080698 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062d778-3753-4d6e-b813-3e51d76699f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:16.099543 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-7062d778-3753-4d6e-b813-3e51d76699f4 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:16.100788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-7062d778-3753-4d6e-b813-3e51d76699f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:16.109228 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 511/1011] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:19:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:16.156044 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76faa158-60f0-45f3-bbcf-7e459636310a None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:16.173594 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76faa158-60f0-45f3-bbcf-7e459636310a None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:16.179694 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4c79c-70d4-438f-a207-15906ef31d18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:16.180464 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4c79c-70d4-438f-a207-15906ef31d18 service nova] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:16.180838 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4c79c-70d4-438f-a207-15906ef31d18 service nova] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:16.181170 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4c79c-70d4-438f-a207-15906ef31d18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:16.192334 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4c79c-70d4-438f-a207-15906ef31d18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:16.194381 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4c79c-70d4-438f-a207-15906ef31d18 service nova] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:16.207383 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 501/1012] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:19.368119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71af177-f596-433a-b428-f01040f53c4e None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:19.368868 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71af177-f596-433a-b428-f01040f53c4e None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:19.368868 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71af177-f596-433a-b428-f01040f53c4e None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:19.370033 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 512/1013] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:19.375745 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a154f-00df-4981-981e-9b921d624344 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:19.376228 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a154f-00df-4981-981e-9b921d624344 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:19.376349 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a154f-00df-4981-981e-9b921d624344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:19.395869 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-512a154f-00df-4981-981e-9b921d624344 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:19.397127 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-512a154f-00df-4981-981e-9b921d624344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:19.405884 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 502/1014] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:19:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:19.451880 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71af177-f596-433a-b428-f01040f53c4e None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:19.460590 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=46 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:19:19.467896 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71af177-f596-433a-b428-f01040f53c4e None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:19.473145 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2912e-f641-43c5-a6e2-b05afb1292b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:19.473787 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2912e-f641-43c5-a6e2-b05afb1292b0 service nova] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:19.474087 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2912e-f641-43c5-a6e2-b05afb1292b0 service nova] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:19.474361 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2912e-f641-43c5-a6e2-b05afb1292b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:19.483068 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2912e-f641-43c5-a6e2-b05afb1292b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:19.484728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2912e-f641-43c5-a6e2-b05afb1292b0 service nova] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:19.493938 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 513/1015] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:21.271568 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec280150-179f-40ab-b8f3-f435389ffdd8 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:21.272210 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec280150-179f-40ab-b8f3-f435389ffdd8 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:21.272210 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec280150-179f-40ab-b8f3-f435389ffdd8 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:21.273480 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 503/1016] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:21.279311 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89d8eb-7bb4-4cca-b608-3afe2d7ed4ff None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:21.279792 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89d8eb-7bb4-4cca-b608-3afe2d7ed4ff None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:21.279895 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89d8eb-7bb4-4cca-b608-3afe2d7ed4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:21.299202 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-3f89d8eb-7bb4-4cca-b608-3afe2d7ed4ff None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:21.300396 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-3f89d8eb-7bb4-4cca-b608-3afe2d7ed4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:21.309080 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 514/1017] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:19:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:21.366647 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b890f42-eae8-4a11-8dae-823aabb98ce9 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:21.366969 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b890f42-eae8-4a11-8dae-823aabb98ce9 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:21.367229 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b890f42-eae8-4a11-8dae-823aabb98ce9 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:21.368746 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 504/1018] 10.222.0.15 () {54 vars in 962 bytes} [Fri Jun 24 17:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:21.374128 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bab3e5-2827-4a46-a01b-7a913a0fc922 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:21.374383 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bab3e5-2827-4a46-a01b-7a913a0fc922 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:21.374723 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bab3e5-2827-4a46-a01b-7a913a0fc922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:21.419696 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-10bab3e5-2827-4a46-a01b-7a913a0fc922 None None] MFA Rules not processed for user `cb10c682def54ce9a22445a9b880d8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:21.424654 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-10bab3e5-2827-4a46-a01b-7a913a0fc922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:21.490481 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 515/1019] 10.222.0.15 () {58 vars in 1059 bytes} [Fri Jun 24 17:19:21 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:21.498244 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b890f42-eae8-4a11-8dae-823aabb98ce9 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:21.509762 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b890f42-eae8-4a11-8dae-823aabb98ce9 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:21.514060 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de7b02-8f24-4c6c-9dd1-dfe5bed238e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb10c682def54ce9a22445a9b880d8ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:21.514729 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de7b02-8f24-4c6c-9dd1-dfe5bed238e5 service glance] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:21.515004 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de7b02-8f24-4c6c-9dd1-dfe5bed238e5 service glance] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:21.515267 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de7b02-8f24-4c6c-9dd1-dfe5bed238e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:21.525396 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de7b02-8f24-4c6c-9dd1-dfe5bed238e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:21.526793 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de7b02-8f24-4c6c-9dd1-dfe5bed238e5 service glance] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:21.536450 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 505/1020] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:21.864559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e440569-d128-4982-9282-6c0888ea39f3 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:21.864937 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e440569-d128-4982-9282-6c0888ea39f3 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:21.865123 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e440569-d128-4982-9282-6c0888ea39f3 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:21.866704 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 516/1021] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:21.872211 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac538ff-f6b3-4a55-9907-ca34b3a75558 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:21.872656 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac538ff-f6b3-4a55-9907-ca34b3a75558 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:21.872946 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac538ff-f6b3-4a55-9907-ca34b3a75558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:21.891681 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-8ac538ff-f6b3-4a55-9907-ca34b3a75558 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:21.892874 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-8ac538ff-f6b3-4a55-9907-ca34b3a75558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:21.901065 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 506/1022] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:19:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:21.949588 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e440569-d128-4982-9282-6c0888ea39f3 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:21.963685 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e440569-d128-4982-9282-6c0888ea39f3 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:21.968939 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d334a3b-7d93-4cab-9bcb-fde85e2d6f7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:21.969571 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d334a3b-7d93-4cab-9bcb-fde85e2d6f7b service nova] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:21.969852 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d334a3b-7d93-4cab-9bcb-fde85e2d6f7b service nova] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:21.970124 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d334a3b-7d93-4cab-9bcb-fde85e2d6f7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:21.978237 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d334a3b-7d93-4cab-9bcb-fde85e2d6f7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:21.979871 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d334a3b-7d93-4cab-9bcb-fde85e2d6f7b service nova] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:21.989369 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 517/1023] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:24.617045 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d86d9-91b5-4e3e-ac0b-ccefd8be1eef None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:24.617732 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d86d9-91b5-4e3e-ac0b-ccefd8be1eef None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:24.618226 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d86d9-91b5-4e3e-ac0b-ccefd8be1eef None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:24.620505 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 507/1024] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:19:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:24.627354 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135288ed-13ba-4162-b851-d22e9ec833e8 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:24.627970 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135288ed-13ba-4162-b851-d22e9ec833e8 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:24.628081 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135288ed-13ba-4162-b851-d22e9ec833e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:24.648071 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-135288ed-13ba-4162-b851-d22e9ec833e8 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:24.649287 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-135288ed-13ba-4162-b851-d22e9ec833e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:24.658285 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 518/1025] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:19:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 17:19:24.704945 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d86d9-91b5-4e3e-ac0b-ccefd8be1eef None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:24.722495 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d86d9-91b5-4e3e-ac0b-ccefd8be1eef None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:24.727762 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbe2bd-663a-4a97-a948-7c5899f5053b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:24.728406 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbe2bd-663a-4a97-a948-7c5899f5053b service nova] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:24.728677 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbe2bd-663a-4a97-a948-7c5899f5053b service nova] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:24.728945 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbe2bd-663a-4a97-a948-7c5899f5053b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:24.738410 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbe2bd-663a-4a97-a948-7c5899f5053b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:24.740043 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbe2bd-663a-4a97-a948-7c5899f5053b service nova] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:24.749871 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 508/1026] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:34.642978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=50 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:19:34.745454 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=97 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:19:37.776986 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a244-8719-4f1f-99de-b58e4d459fd0 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:37.777672 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a244-8719-4f1f-99de-b58e4d459fd0 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:37.777672 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a244-8719-4f1f-99de-b58e4d459fd0 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:37.778911 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 519/1027] 10.222.0.15 () {54 vars in 918 bytes} [Fri Jun 24 17:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:37.784664 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581b4fc-7dff-4003-be9d-baf600726c93 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:37.785176 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581b4fc-7dff-4003-be9d-baf600726c93 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:37.785176 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581b4fc-7dff-4003-be9d-baf600726c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:37.804706 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-5581b4fc-7dff-4003-be9d-baf600726c93 None None] MFA Rules not processed for user `b318b7cfb1c5485cba96997ddd73945c`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:37.805917 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-5581b4fc-7dff-4003-be9d-baf600726c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:37.815385 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 509/1028] 10.222.0.15 () {58 vars in 1015 bytes} [Fri Jun 24 17:19:37 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:37.830720 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c68b9-2eda-481e-b677-9d8d15b39588 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:37.831007 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c68b9-2eda-481e-b677-9d8d15b39588 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:37.831272 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c68b9-2eda-481e-b677-9d8d15b39588 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:37.832627 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 520/1029] 10.222.0.15 () {54 vars in 918 bytes} [Fri Jun 24 17:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:37.837362 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb435c-3087-48f5-a178-acef07661e99 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:37.837645 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb435c-3087-48f5-a178-acef07661e99 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:37.837920 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb435c-3087-48f5-a178-acef07661e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:37.856216 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-9afb435c-3087-48f5-a178-acef07661e99 None None] MFA Rules not processed for user `9ff8200a750d49b1830c58f279e569c3`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:37.857383 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-9afb435c-3087-48f5-a178-acef07661e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:37.866395 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 510/1030] 10.222.0.15 () {58 vars in 1015 bytes} [Fri Jun 24 17:19:37 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 17:19:40.640842 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c36dd0-41c0-419a-a94b-1476d82d195c None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:40.641628 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c36dd0-41c0-419a-a94b-1476d82d195c None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:40.641628 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c36dd0-41c0-419a-a94b-1476d82d195c None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:40.642736 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 521/1031] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 17:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:40.648502 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b668f-1da8-4ae2-a04e-e1cfedd3fdd9 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:40.649032 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b668f-1da8-4ae2-a04e-e1cfedd3fdd9 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:40.649032 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b668f-1da8-4ae2-a04e-e1cfedd3fdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:40.669431 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-5a9b668f-1da8-4ae2-a04e-e1cfedd3fdd9 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:40.670655 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-5a9b668f-1da8-4ae2-a04e-e1cfedd3fdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:40.679995 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 511/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 17:19:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:40.735387 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c36dd0-41c0-419a-a94b-1476d82d195c None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:40.750753 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c36dd0-41c0-419a-a94b-1476d82d195c None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:40.756725 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f47ac-dbee-4255-865c-8cbeea012d02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:40.757372 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f47ac-dbee-4255-865c-8cbeea012d02 service nova] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:40.757679 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f47ac-dbee-4255-865c-8cbeea012d02 service nova] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:40.757907 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f47ac-dbee-4255-865c-8cbeea012d02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:40.767208 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f47ac-dbee-4255-865c-8cbeea012d02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:40.768795 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f47ac-dbee-4255-865c-8cbeea012d02 service nova] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:40.779224 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 522/1033] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:41.753545 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9b040-de70-496d-874a-a9562773953c None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:41.754115 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9b040-de70-496d-874a-a9562773953c None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:41.754115 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9b040-de70-496d-874a-a9562773953c None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:41.755390 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 512/1034] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 17:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:41.760934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e975338-6f7f-43ef-aa6f-7a488e239f22 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:41.761379 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e975338-6f7f-43ef-aa6f-7a488e239f22 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:41.761489 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e975338-6f7f-43ef-aa6f-7a488e239f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:41.780493 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-8e975338-6f7f-43ef-aa6f-7a488e239f22 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:41.782010 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-8e975338-6f7f-43ef-aa6f-7a488e239f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:41.790762 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 523/1035] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 17:19:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:42.010938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9b040-de70-496d-874a-a9562773953c None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:42.028042 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9b040-de70-496d-874a-a9562773953c None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:42.034812 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd74ff0-6e2e-4822-adc3-acc8cd5a8741 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:42.035474 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd74ff0-6e2e-4822-adc3-acc8cd5a8741 service nova] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:42.035771 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd74ff0-6e2e-4822-adc3-acc8cd5a8741 service nova] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:42.036014 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd74ff0-6e2e-4822-adc3-acc8cd5a8741 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:42.045671 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd74ff0-6e2e-4822-adc3-acc8cd5a8741 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:42.047485 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd74ff0-6e2e-4822-adc3-acc8cd5a8741 service nova] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:42.057190 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 513/1036] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:42.958815 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c062af-2357-416b-9336-f15c98cfdbbb None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:42.959404 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c062af-2357-416b-9336-f15c98cfdbbb None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:42.959404 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c062af-2357-416b-9336-f15c98cfdbbb None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:42.960818 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 524/1037] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 17:19:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:42.966122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c3779-58c1-42d9-9775-5991659a0959 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:42.966643 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c3779-58c1-42d9-9775-5991659a0959 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:42.966643 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c3779-58c1-42d9-9775-5991659a0959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:42.991067 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-889c3779-58c1-42d9-9775-5991659a0959 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:42.992292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-889c3779-58c1-42d9-9775-5991659a0959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:43.002003 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 514/1038] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 17:19:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:43.160110 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c062af-2357-416b-9336-f15c98cfdbbb None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:43.176186 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c062af-2357-416b-9336-f15c98cfdbbb None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:43.181366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4bd0f-b7c0-49dd-a779-23df16c7815b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:43.182020 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4bd0f-b7c0-49dd-a779-23df16c7815b service nova] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:43.182297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4bd0f-b7c0-49dd-a779-23df16c7815b service nova] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:43.182597 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4bd0f-b7c0-49dd-a779-23df16c7815b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:43.192200 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4bd0f-b7c0-49dd-a779-23df16c7815b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:43.193816 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4bd0f-b7c0-49dd-a779-23df16c7815b service nova] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:43.204429 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 525/1039] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:44.081148 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e33ac1-f5a1-41d2-a542-2e28ac361496 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:44.081759 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e33ac1-f5a1-41d2-a542-2e28ac361496 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:44.081759 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e33ac1-f5a1-41d2-a542-2e28ac361496 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:44.083158 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 515/1040] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 17:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:44.088335 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc61618-6512-48a0-9d2b-dcea455bfafc None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:44.088767 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc61618-6512-48a0-9d2b-dcea455bfafc None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:44.088860 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc61618-6512-48a0-9d2b-dcea455bfafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:44.107980 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-cbc61618-6512-48a0-9d2b-dcea455bfafc None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:44.109209 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-cbc61618-6512-48a0-9d2b-dcea455bfafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:44.119976 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 526/1041] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 17:19:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:44.276549 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e33ac1-f5a1-41d2-a542-2e28ac361496 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:44.296754 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e33ac1-f5a1-41d2-a542-2e28ac361496 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:44.304923 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef21039-c547-4cdc-a73b-d9f37a205169 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:44.305809 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef21039-c547-4cdc-a73b-d9f37a205169 service nova] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:44.306297 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef21039-c547-4cdc-a73b-d9f37a205169 service nova] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:44.306853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef21039-c547-4cdc-a73b-d9f37a205169 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:44.321243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef21039-c547-4cdc-a73b-d9f37a205169 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:44.323814 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef21039-c547-4cdc-a73b-d9f37a205169 service nova] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:44.339698 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 516/1042] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:45.233659 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79398fef-07c2-491a-bd81-f5c95ae41595 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:45.234258 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79398fef-07c2-491a-bd81-f5c95ae41595 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:45.234258 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79398fef-07c2-491a-bd81-f5c95ae41595 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:45.236106 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 527/1043] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 17:19:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:45.241311 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043c1bd-b377-42ef-98f0-1daa48a2f138 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:45.241749 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043c1bd-b377-42ef-98f0-1daa48a2f138 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:45.241953 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043c1bd-b377-42ef-98f0-1daa48a2f138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:45.261817 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-a043c1bd-b377-42ef-98f0-1daa48a2f138 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:45.263049 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-a043c1bd-b377-42ef-98f0-1daa48a2f138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:45.272445 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 517/1044] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 17:19:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:45.429368 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79398fef-07c2-491a-bd81-f5c95ae41595 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:45.443725 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79398fef-07c2-491a-bd81-f5c95ae41595 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:45.448806 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69c8e2-2d68-44cf-b942-34e81e8f607f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:45.449469 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69c8e2-2d68-44cf-b942-34e81e8f607f service nova] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:45.449721 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69c8e2-2d68-44cf-b942-34e81e8f607f service nova] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:45.449997 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69c8e2-2d68-44cf-b942-34e81e8f607f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:45.458960 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69c8e2-2d68-44cf-b942-34e81e8f607f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:45.460620 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69c8e2-2d68-44cf-b942-34e81e8f607f service nova] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:45.470944 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 528/1045] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:46.307470 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16c6d3-ed06-4868-880e-a767543fd105 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:46.308122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16c6d3-ed06-4868-880e-a767543fd105 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:46.308122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16c6d3-ed06-4868-880e-a767543fd105 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:46.309400 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 518/1046] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 17:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 17:19:46.314907 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63073fea-13ae-4f33-9cd8-78be4f6dfcdf None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:46.315366 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63073fea-13ae-4f33-9cd8-78be4f6dfcdf None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:46.315501 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63073fea-13ae-4f33-9cd8-78be4f6dfcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:46.334950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-63073fea-13ae-4f33-9cd8-78be4f6dfcdf None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:46.336189 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-63073fea-13ae-4f33-9cd8-78be4f6dfcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:46.345432 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 529/1047] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 17:19:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:46.502073 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16c6d3-ed06-4868-880e-a767543fd105 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:46.517201 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16c6d3-ed06-4868-880e-a767543fd105 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:46.523272 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605d939-924f-42ae-9f39-1857a68b9d17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:46.523923 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605d939-924f-42ae-9f39-1857a68b9d17 service nova] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:46.524197 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605d939-924f-42ae-9f39-1857a68b9d17 service nova] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:46.524465 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605d939-924f-42ae-9f39-1857a68b9d17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:46.534476 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605d939-924f-42ae-9f39-1857a68b9d17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:46.536131 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605d939-924f-42ae-9f39-1857a68b9d17 service nova] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:46.546875 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 519/1048] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:47.368861 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f744dd8-53de-40fb-b227-e39a7e0e39aa None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:47.369487 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f744dd8-53de-40fb-b227-e39a7e0e39aa None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:47.369487 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f744dd8-53de-40fb-b227-e39a7e0e39aa None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:47.370800 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 530/1049] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 17:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:47.375888 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7eacab-4646-4737-a3c1-a46489e79090 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:47.376389 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7eacab-4646-4737-a3c1-a46489e79090 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:47.376389 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7eacab-4646-4737-a3c1-a46489e79090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:47.397191 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-6b7eacab-4646-4737-a3c1-a46489e79090 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:47.398453 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-6b7eacab-4646-4737-a3c1-a46489e79090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:47.408196 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 520/1050] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 17:19:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:47.563435 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f744dd8-53de-40fb-b227-e39a7e0e39aa None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:47.579030 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f744dd8-53de-40fb-b227-e39a7e0e39aa None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:47.584625 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cadcff-10dd-43f8-8a00-9a74080a5edf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:47.585262 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cadcff-10dd-43f8-8a00-9a74080a5edf service nova] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:47.585536 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cadcff-10dd-43f8-8a00-9a74080a5edf service nova] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:47.585806 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cadcff-10dd-43f8-8a00-9a74080a5edf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:47.593971 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cadcff-10dd-43f8-8a00-9a74080a5edf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:47.595730 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cadcff-10dd-43f8-8a00-9a74080a5edf service nova] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:47.605307 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 531/1051] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:48.422420 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce5f6d-79e2-47d2-b6e7-fcef0f771cdb None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:48.423018 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce5f6d-79e2-47d2-b6e7-fcef0f771cdb None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:48.423018 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce5f6d-79e2-47d2-b6e7-fcef0f771cdb None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:48.424725 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 521/1052] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 17:19:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:48.430840 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419401c-9cf4-4ab3-b252-b4550876d69f None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:48.431298 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419401c-9cf4-4ab3-b252-b4550876d69f None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:48.431410 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419401c-9cf4-4ab3-b252-b4550876d69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:48.460055 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-6419401c-9cf4-4ab3-b252-b4550876d69f None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:48.461798 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-6419401c-9cf4-4ab3-b252-b4550876d69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:48.473893 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 532/1053] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 17:19:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:48.629118 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce5f6d-79e2-47d2-b6e7-fcef0f771cdb None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:48.654831 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce5f6d-79e2-47d2-b6e7-fcef0f771cdb None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:48.662243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8d4f9-36ea-45f7-86f1-e35e397f58d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:48.662915 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8d4f9-36ea-45f7-86f1-e35e397f58d2 service nova] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:48.663192 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8d4f9-36ea-45f7-86f1-e35e397f58d2 service nova] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:48.663471 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8d4f9-36ea-45f7-86f1-e35e397f58d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:48.672885 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8d4f9-36ea-45f7-86f1-e35e397f58d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:48.674529 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8d4f9-36ea-45f7-86f1-e35e397f58d2 service nova] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:48.684715 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 522/1054] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:49.593823 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa93bc6-e3ca-4652-afca-712295ebd884 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:49.594765 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa93bc6-e3ca-4652-afca-712295ebd884 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:49.594765 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa93bc6-e3ca-4652-afca-712295ebd884 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:49.596255 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 533/1055] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 17:19:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:49.602476 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097065b-ee6b-49db-9086-e9e293491cc0 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:49.603133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097065b-ee6b-49db-9086-e9e293491cc0 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:49.603133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097065b-ee6b-49db-9086-e9e293491cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:49.622035 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-a097065b-ee6b-49db-9086-e9e293491cc0 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:49.623291 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-a097065b-ee6b-49db-9086-e9e293491cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:49.631999 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 523/1056] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 17:19:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:49.805109 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa93bc6-e3ca-4652-afca-712295ebd884 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:49.822838 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa93bc6-e3ca-4652-afca-712295ebd884 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:49.830863 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4ad0c-c9a5-426a-8580-6407ffaf1e62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:49.831510 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4ad0c-c9a5-426a-8580-6407ffaf1e62 service nova] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:49.831794 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4ad0c-c9a5-426a-8580-6407ffaf1e62 service nova] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:49.832068 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4ad0c-c9a5-426a-8580-6407ffaf1e62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:49.841106 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4ad0c-c9a5-426a-8580-6407ffaf1e62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:49.842827 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4ad0c-c9a5-426a-8580-6407ffaf1e62 service nova] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:49.852861 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 534/1057] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:51.995356 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d23fb-e2b2-47b8-8f38-3f361ce4ae69 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:51.995964 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d23fb-e2b2-47b8-8f38-3f361ce4ae69 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:51.995964 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d23fb-e2b2-47b8-8f38-3f361ce4ae69 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:51.997345 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 524/1058] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 17:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:19:52.003481 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a6c30-d9d7-40c2-a59b-ece302beb8c2 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:52.004008 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a6c30-d9d7-40c2-a59b-ece302beb8c2 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:52.004008 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a6c30-d9d7-40c2-a59b-ece302beb8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:52.023514 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-601a6c30-d9d7-40c2-a59b-ece302beb8c2 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:52.024810 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-601a6c30-d9d7-40c2-a59b-ece302beb8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:52.034843 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 535/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 17:19:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:52.075590 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d23fb-e2b2-47b8-8f38-3f361ce4ae69 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:52.087937 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d23fb-e2b2-47b8-8f38-3f361ce4ae69 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:52.094664 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b44a53-8c5a-4539-9ee8-8315b58b187a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:52.095678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b44a53-8c5a-4539-9ee8-8315b58b187a service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:52.096221 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b44a53-8c5a-4539-9ee8-8315b58b187a service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:52.096221 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b44a53-8c5a-4539-9ee8-8315b58b187a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:52.106313 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b44a53-8c5a-4539-9ee8-8315b58b187a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:52.107964 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b44a53-8c5a-4539-9ee8-8315b58b187a service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:52.118368 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 525/1060] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:54.776576 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6d03e-ce40-4920-b91f-a10b917e1856 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:54.777509 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6d03e-ce40-4920-b91f-a10b917e1856 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:54.777509 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6d03e-ce40-4920-b91f-a10b917e1856 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:54.778708 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 536/1061] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 17:19:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 17:19:54.785390 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac79ccf-1f42-4087-9683-0f8e641c82fc None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:54.785842 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac79ccf-1f42-4087-9683-0f8e641c82fc None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:54.785954 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac79ccf-1f42-4087-9683-0f8e641c82fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:54.805125 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-1ac79ccf-1f42-4087-9683-0f8e641c82fc None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:54.806524 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-1ac79ccf-1f42-4087-9683-0f8e641c82fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:54.815116 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 526/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 17:19:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:19:54.855817 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6d03e-ce40-4920-b91f-a10b917e1856 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:54.869139 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6d03e-ce40-4920-b91f-a10b917e1856 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:54.872510 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819c820-7ec0-445c-b74c-380125483af2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:54.872510 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819c820-7ec0-445c-b74c-380125483af2 service neutron] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:54.872510 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819c820-7ec0-445c-b74c-380125483af2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:54.873000 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819c820-7ec0-445c-b74c-380125483af2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:54.883377 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819c820-7ec0-445c-b74c-380125483af2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:54.885172 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819c820-7ec0-445c-b74c-380125483af2 service neutron] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:54.901940 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 537/1063] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:19:57.773051 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec7f3a-b16e-4e29-bfe8-c765e7748b4d None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:57.773765 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec7f3a-b16e-4e29-bfe8-c765e7748b4d None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:57.773765 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec7f3a-b16e-4e29-bfe8-c765e7748b4d None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:57.774862 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 527/1064] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 17:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 17:19:57.780878 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fce56-c70d-46b6-824b-76ee26c4cd95 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:57.781525 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fce56-c70d-46b6-824b-76ee26c4cd95 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:57.781525 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fce56-c70d-46b6-824b-76ee26c4cd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:57.800940 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-1d1fce56-c70d-46b6-824b-76ee26c4cd95 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:19:57.802184 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-1d1fce56-c70d-46b6-824b-76ee26c4cd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:19:57.810026 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 538/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 17:19:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 17:19:57.864885 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec7f3a-b16e-4e29-bfe8-c765e7748b4d None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:19:57.880891 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec7f3a-b16e-4e29-bfe8-c765e7748b4d None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:19:57.885870 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6bdb3-6a3a-4b5f-b7f1-5a7ad3cd04af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:19:57.886619 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6bdb3-6a3a-4b5f-b7f1-5a7ad3cd04af service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:19:57.886834 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6bdb3-6a3a-4b5f-b7f1-5a7ad3cd04af service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:19:57.887103 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6bdb3-6a3a-4b5f-b7f1-5a7ad3cd04af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:19:57.897292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6bdb3-6a3a-4b5f-b7f1-5a7ad3cd04af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:19:57.898785 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6bdb3-6a3a-4b5f-b7f1-5a7ad3cd04af service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:19:57.910083 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 528/1066] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:19:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:20:00.384072 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec111b-0da7-42c3-9c6a-f2f23a29c8f5 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:00.384604 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec111b-0da7-42c3-9c6a-f2f23a29c8f5 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:00.384604 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec111b-0da7-42c3-9c6a-f2f23a29c8f5 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:00.385886 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 539/1067] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 17:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 17:20:00.391663 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdcdeb-8350-482f-b2da-b4872376f3d5 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:00.392173 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdcdeb-8350-482f-b2da-b4872376f3d5 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:00.392286 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdcdeb-8350-482f-b2da-b4872376f3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:00.419409 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-b9bdcdeb-8350-482f-b2da-b4872376f3d5 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:20:00.421349 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-b9bdcdeb-8350-482f-b2da-b4872376f3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:20:00.433920 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 529/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 17:20:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:20:00.492401 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec111b-0da7-42c3-9c6a-f2f23a29c8f5 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:20:00.506201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec111b-0da7-42c3-9c6a-f2f23a29c8f5 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:20:00.512247 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edf8cd-9a83-49fa-a645-e209f8c996db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:20:00.513284 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edf8cd-9a83-49fa-a645-e209f8c996db service neutron] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:00.513748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edf8cd-9a83-49fa-a645-e209f8c996db service neutron] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:00.514204 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edf8cd-9a83-49fa-a645-e209f8c996db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:00.530548 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edf8cd-9a83-49fa-a645-e209f8c996db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:20:00.533569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edf8cd-9a83-49fa-a645-e209f8c996db service neutron] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:20:00.547964 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 540/1069] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:20:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:20:02.999809 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc57268-62e3-459f-a5a2-e124a0940529 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:03.000365 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc57268-62e3-459f-a5a2-e124a0940529 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:03.000365 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc57268-62e3-459f-a5a2-e124a0940529 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:03.001658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 530/1070] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 17:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:20:03.008013 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b2fad-cf5f-4509-983c-2008b0bb8597 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:03.008556 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b2fad-cf5f-4509-983c-2008b0bb8597 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:03.008556 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b2fad-cf5f-4509-983c-2008b0bb8597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:03.028472 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-0b9b2fad-cf5f-4509-983c-2008b0bb8597 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:20:03.030230 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-0b9b2fad-cf5f-4509-983c-2008b0bb8597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:20:03.040969 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 541/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 17:20:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:20:03.082748 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc57268-62e3-459f-a5a2-e124a0940529 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:20:03.094460 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc57268-62e3-459f-a5a2-e124a0940529 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:20:03.099831 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437e363-18dd-4530-8869-5c7d0203e5ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:20:03.100946 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437e363-18dd-4530-8869-5c7d0203e5ec service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:03.101425 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437e363-18dd-4530-8869-5c7d0203e5ec service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:03.103474 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437e363-18dd-4530-8869-5c7d0203e5ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:03.116823 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437e363-18dd-4530-8869-5c7d0203e5ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:20:03.118279 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437e363-18dd-4530-8869-5c7d0203e5ec service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:20:03.129740 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 531/1072] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:20:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:20:05.684040 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb66e29-e250-4aa9-82a4-bc04bd1cee9f None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:05.684633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb66e29-e250-4aa9-82a4-bc04bd1cee9f None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:05.684713 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb66e29-e250-4aa9-82a4-bc04bd1cee9f None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:05.686242 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 542/1073] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 17:20:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:20:05.693385 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b30b67-b42f-4e85-9b03-88fbf215ea79 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:05.693941 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b30b67-b42f-4e85-9b03-88fbf215ea79 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:05.693941 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b30b67-b42f-4e85-9b03-88fbf215ea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:05.700187 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=70 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:20:05.714737 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-e2b30b67-b42f-4e85-9b03-88fbf215ea79 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:20:05.715976 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-e2b30b67-b42f-4e85-9b03-88fbf215ea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:20:05.725036 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 532/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 17:20:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:20:05.766464 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb66e29-e250-4aa9-82a4-bc04bd1cee9f None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:20:05.772492 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=64 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:20:05.779817 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb66e29-e250-4aa9-82a4-bc04bd1cee9f None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:20:05.783873 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5343d-74c3-4704-9580-f5f11e60af2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:20:05.787376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5343d-74c3-4704-9580-f5f11e60af2c service neutron] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:05.787376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5343d-74c3-4704-9580-f5f11e60af2c service neutron] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:05.787376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5343d-74c3-4704-9580-f5f11e60af2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:05.795279 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5343d-74c3-4704-9580-f5f11e60af2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:20:05.796760 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5343d-74c3-4704-9580-f5f11e60af2c service neutron] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:20:05.807299 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 543/1075] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:20:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:20:08.427231 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209a2b8-7c80-4e36-a3c0-497f89f6dfee None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:08.427872 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209a2b8-7c80-4e36-a3c0-497f89f6dfee None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:08.427872 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209a2b8-7c80-4e36-a3c0-497f89f6dfee None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:08.429182 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 533/1076] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 17:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:20:08.434560 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434afb2-39ea-49cd-a5cb-9ebb0d9b8e13 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:08.435045 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434afb2-39ea-49cd-a5cb-9ebb0d9b8e13 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:08.435146 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434afb2-39ea-49cd-a5cb-9ebb0d9b8e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:08.455584 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-3434afb2-39ea-49cd-a5cb-9ebb0d9b8e13 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:20:08.456932 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-3434afb2-39ea-49cd-a5cb-9ebb0d9b8e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:20:08.466602 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 544/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 17:20:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:20:08.506922 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209a2b8-7c80-4e36-a3c0-497f89f6dfee None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:20:08.519258 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209a2b8-7c80-4e36-a3c0-497f89f6dfee None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:20:08.523678 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf804c8-c584-477f-9f2f-8368eb502cf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:20:08.524350 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf804c8-c584-477f-9f2f-8368eb502cf9 service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:08.524698 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf804c8-c584-477f-9f2f-8368eb502cf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:08.524946 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf804c8-c584-477f-9f2f-8368eb502cf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:08.538225 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf804c8-c584-477f-9f2f-8368eb502cf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:20:08.540246 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf804c8-c584-477f-9f2f-8368eb502cf9 service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:20:08.556511 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 534/1078] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:20:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:20:10.921297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869e07c-77e7-49c9-90d8-320d6b7037c3 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:10.921840 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869e07c-77e7-49c9-90d8-320d6b7037c3 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:10.921840 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869e07c-77e7-49c9-90d8-320d6b7037c3 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:10.923848 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 545/1079] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 17:20:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:20:10.931195 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e294f8-055d-464e-9cc8-82fa60de72af None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:10.931626 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e294f8-055d-464e-9cc8-82fa60de72af None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:10.931734 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e294f8-055d-464e-9cc8-82fa60de72af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:10.950909 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-f9e294f8-055d-464e-9cc8-82fa60de72af None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:20:10.952146 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-f9e294f8-055d-464e-9cc8-82fa60de72af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:20:10.961532 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 535/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 17:20:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:20:11.005810 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869e07c-77e7-49c9-90d8-320d6b7037c3 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:20:11.025139 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869e07c-77e7-49c9-90d8-320d6b7037c3 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:20:11.031330 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc68494-d987-46bb-b875-c7784b38b7f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:20:11.032142 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc68494-d987-46bb-b875-c7784b38b7f8 service neutron] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:11.032415 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc68494-d987-46bb-b875-c7784b38b7f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:11.032678 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc68494-d987-46bb-b875-c7784b38b7f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:11.044023 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc68494-d987-46bb-b875-c7784b38b7f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:20:11.045493 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc68494-d987-46bb-b875-c7784b38b7f8 service neutron] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:20:11.055792 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 546/1081] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:20:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:20:13.381438 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6489a8c-d90e-4a01-8133-eeca49120c1b None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:13.382345 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6489a8c-d90e-4a01-8133-eeca49120c1b None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:13.382345 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6489a8c-d90e-4a01-8133-eeca49120c1b None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:13.384552 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 536/1082] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 17:20:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:20:13.393360 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65dd966-0877-4ada-9028-043f3a7ed4c6 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:13.394033 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65dd966-0877-4ada-9028-043f3a7ed4c6 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:13.394135 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65dd966-0877-4ada-9028-043f3a7ed4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:13.415703 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-a65dd966-0877-4ada-9028-043f3a7ed4c6 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:20:13.416917 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-a65dd966-0877-4ada-9028-043f3a7ed4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:20:13.425881 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 547/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 17:20:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:20:13.467598 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6489a8c-d90e-4a01-8133-eeca49120c1b None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:20:13.487019 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6489a8c-d90e-4a01-8133-eeca49120c1b None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:20:13.491747 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd43c4d-90e5-4831-81dc-9a16f6668062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:20:13.492390 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd43c4d-90e5-4831-81dc-9a16f6668062 service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:13.492671 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd43c4d-90e5-4831-81dc-9a16f6668062 service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:13.492942 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd43c4d-90e5-4831-81dc-9a16f6668062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:13.502691 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd43c4d-90e5-4831-81dc-9a16f6668062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:20:13.504184 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd43c4d-90e5-4831-81dc-9a16f6668062 service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:20:13.514053 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 537/1084] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:20:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:20:15.892246 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e24c6-9c2b-4182-a5b6-c0c05d06cd6b None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:15.892797 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e24c6-9c2b-4182-a5b6-c0c05d06cd6b None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:15.892797 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e24c6-9c2b-4182-a5b6-c0c05d06cd6b None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:15.894139 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 548/1085] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 17:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:20:15.900505 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301579f-32c9-46c1-8cbe-70eff8bf4a05 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:15.901243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301579f-32c9-46c1-8cbe-70eff8bf4a05 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:15.901442 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301579f-32c9-46c1-8cbe-70eff8bf4a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:15.929983 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-b301579f-32c9-46c1-8cbe-70eff8bf4a05 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:20:15.931452 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-b301579f-32c9-46c1-8cbe-70eff8bf4a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:20:15.940151 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 538/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 17:20:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:20:15.978386 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e24c6-9c2b-4182-a5b6-c0c05d06cd6b None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:20:15.990679 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e24c6-9c2b-4182-a5b6-c0c05d06cd6b None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:20:15.994204 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd64cf0-e0a2-4ea4-a7a7-6139db636de9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:20:15.994877 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd64cf0-e0a2-4ea4-a7a7-6139db636de9 service neutron] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:15.995150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd64cf0-e0a2-4ea4-a7a7-6139db636de9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:15.995416 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd64cf0-e0a2-4ea4-a7a7-6139db636de9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:16.004425 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd64cf0-e0a2-4ea4-a7a7-6139db636de9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:20:16.005855 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd64cf0-e0a2-4ea4-a7a7-6139db636de9 service neutron] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:20:16.014986 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 549/1087] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:20:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:20:25.922742 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=20 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:20:26.011049 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=23 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:20:53.206905 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f122e-29af-4860-8162-142794a44997 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:53.207532 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f122e-29af-4860-8162-142794a44997 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:53.207532 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f122e-29af-4860-8162-142794a44997 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:53.208781 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 539/1088] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:20:53.215646 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085df8c-cce1-4087-a1d3-19f20c091bcd None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:53.216184 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085df8c-cce1-4087-a1d3-19f20c091bcd None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:53.216312 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085df8c-cce1-4087-a1d3-19f20c091bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:53.241277 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-4085df8c-cce1-4087-a1d3-19f20c091bcd None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:20:53.242491 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-4085df8c-cce1-4087-a1d3-19f20c091bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:20:53.251607 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 550/1089] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:20:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:20:53.309889 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65325a2-f07c-4a51-ad58-0cd71134561f None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:53.310145 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65325a2-f07c-4a51-ad58-0cd71134561f None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:53.310437 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65325a2-f07c-4a51-ad58-0cd71134561f None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:53.311841 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 540/1090] 10.222.0.15 () {54 vars in 962 bytes} [Fri Jun 24 17:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:20:53.317141 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c1c89-610a-48d8-8680-cbceb2b2aa21 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:53.317707 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c1c89-610a-48d8-8680-cbceb2b2aa21 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:53.317988 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c1c89-610a-48d8-8680-cbceb2b2aa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:53.336506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-0b6c1c89-610a-48d8-8680-cbceb2b2aa21 None None] MFA Rules not processed for user `cb10c682def54ce9a22445a9b880d8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:20:53.337695 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-0b6c1c89-610a-48d8-8680-cbceb2b2aa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:20:53.344515 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 551/1091] 10.222.0.15 () {58 vars in 1059 bytes} [Fri Jun 24 17:20:53 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:20:53.352097 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65325a2-f07c-4a51-ad58-0cd71134561f None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:20:53.364938 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65325a2-f07c-4a51-ad58-0cd71134561f None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:20:53.369400 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641db653-fc7a-474b-86c8-9eff1b61e2a0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb10c682def54ce9a22445a9b880d8ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:20:53.370039 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641db653-fc7a-474b-86c8-9eff1b61e2a0 service glance] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:53.370311 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641db653-fc7a-474b-86c8-9eff1b61e2a0 service glance] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:53.370593 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641db653-fc7a-474b-86c8-9eff1b61e2a0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:53.381251 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641db653-fc7a-474b-86c8-9eff1b61e2a0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:20:53.382820 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641db653-fc7a-474b-86c8-9eff1b61e2a0 service glance] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:20:53.393911 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 541/1092] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:20:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:20:55.894562 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975b1f0-6089-417e-ab5e-5b52e31fbb80 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:55.895160 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975b1f0-6089-417e-ab5e-5b52e31fbb80 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:55.895160 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975b1f0-6089-417e-ab5e-5b52e31fbb80 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:55.896506 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 552/1093] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:20:55.902362 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb18c58-9c51-40af-9ad8-a5ec4f5f89b7 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:55.902899 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb18c58-9c51-40af-9ad8-a5ec4f5f89b7 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:55.902899 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb18c58-9c51-40af-9ad8-a5ec4f5f89b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:55.923434 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-8bb18c58-9c51-40af-9ad8-a5ec4f5f89b7 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:20:55.924657 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-8bb18c58-9c51-40af-9ad8-a5ec4f5f89b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:20:55.935308 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 542/1094] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:20:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:20:55.960412 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975b1f0-6089-417e-ab5e-5b52e31fbb80 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:20:55.973970 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975b1f0-6089-417e-ab5e-5b52e31fbb80 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:20:55.980001 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3629e6-1b27-45c3-866e-3aa9855e0207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:20:55.980806 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3629e6-1b27-45c3-866e-3aa9855e0207 admin admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:55.981017 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3629e6-1b27-45c3-866e-3aa9855e0207 admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:55.981712 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3629e6-1b27-45c3-866e-3aa9855e0207 admin admin] PATH_INFO: `/v3/projects` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:55.982257 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3629e6-1b27-45c3-866e-3aa9855e0207 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:20:55.983978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: WARNING py.warnings [None req-0f3629e6-1b27-45c3-866e-3aa9855e0207 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 17:20:55.983978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: warnings.warn(msg) Jun 24 17:20:55.983978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: Jun 24 17:20:55.985170 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3629e6-1b27-45c3-866e-3aa9855e0207 admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:20:56.007514 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 553/1095] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 24 17:20:55 2022] GET /identity/v3/projects => generated 1606 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 17:20:58.329888 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604872e-186b-47e8-b883-1199dd5e9f69 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:58.330465 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604872e-186b-47e8-b883-1199dd5e9f69 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:58.330465 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604872e-186b-47e8-b883-1199dd5e9f69 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:58.331700 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 543/1096] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:20:58.337394 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c5219-1e79-404e-b449-edbd091246bc None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:58.337905 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c5219-1e79-404e-b449-edbd091246bc None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:58.337905 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c5219-1e79-404e-b449-edbd091246bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:58.357831 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-047c5219-1e79-404e-b449-edbd091246bc None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:20:58.359079 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-047c5219-1e79-404e-b449-edbd091246bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:20:58.368885 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 554/1097] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:20:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:20:58.414694 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604872e-186b-47e8-b883-1199dd5e9f69 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:20:58.432757 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604872e-186b-47e8-b883-1199dd5e9f69 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:20:58.438331 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a90f6-b205-427c-9cd1-a014fdfcefc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:20:58.439027 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a90f6-b205-427c-9cd1-a014fdfcefc6 service nova] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:20:58.439309 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a90f6-b205-427c-9cd1-a014fdfcefc6 service nova] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:20:58.439583 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a90f6-b205-427c-9cd1-a014fdfcefc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:20:58.449972 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a90f6-b205-427c-9cd1-a014fdfcefc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:20:58.451625 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a90f6-b205-427c-9cd1-a014fdfcefc6 service nova] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:20:58.462531 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 544/1098] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:20:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:21:00.973839 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf424b5-b013-40b6-aaa8-c3a166112bc6 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:21:00.974420 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf424b5-b013-40b6-aaa8-c3a166112bc6 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:21:00.974420 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf424b5-b013-40b6-aaa8-c3a166112bc6 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:21:00.975911 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 555/1099] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:21:00.981822 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5b1ca-71b4-487f-95ca-f732ec5e096b None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:21:00.982298 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5b1ca-71b4-487f-95ca-f732ec5e096b None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:21:00.982424 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5b1ca-71b4-487f-95ca-f732ec5e096b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:21:01.002103 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-52e5b1ca-71b4-487f-95ca-f732ec5e096b None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:21:01.003382 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-52e5b1ca-71b4-487f-95ca-f732ec5e096b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:21:01.012662 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 545/1100] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:21:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:21:01.050382 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf424b5-b013-40b6-aaa8-c3a166112bc6 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:21:01.062662 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf424b5-b013-40b6-aaa8-c3a166112bc6 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:21:01.066620 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f23dba-afaa-4aed-be74-569835d64250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:21:01.067271 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f23dba-afaa-4aed-be74-569835d64250 service neutron] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:21:01.067547 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f23dba-afaa-4aed-be74-569835d64250 service neutron] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:21:01.067818 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f23dba-afaa-4aed-be74-569835d64250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:21:01.077860 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f23dba-afaa-4aed-be74-569835d64250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:21:01.079347 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f23dba-afaa-4aed-be74-569835d64250 service neutron] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:21:01.090554 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 556/1101] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:21:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:21:03.434262 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611289a1-b7e6-4f8d-89bd-7a5c04e6fc72 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:21:03.435138 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611289a1-b7e6-4f8d-89bd-7a5c04e6fc72 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:21:03.435247 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611289a1-b7e6-4f8d-89bd-7a5c04e6fc72 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:21:03.437417 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 546/1102] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:21:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:21:03.445484 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c923a-7a82-4777-972f-7f08b305f97d None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:21:03.445967 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c923a-7a82-4777-972f-7f08b305f97d None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:21:03.446086 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c923a-7a82-4777-972f-7f08b305f97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:21:03.465876 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-1d4c923a-7a82-4777-972f-7f08b305f97d None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:21:03.467126 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-1d4c923a-7a82-4777-972f-7f08b305f97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:21:03.476851 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 557/1103] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:21:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:21:03.519184 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611289a1-b7e6-4f8d-89bd-7a5c04e6fc72 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:21:03.537758 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611289a1-b7e6-4f8d-89bd-7a5c04e6fc72 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:21:03.542592 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347f864-33bb-47f6-8803-1a37a8a88113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:21:03.543246 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347f864-33bb-47f6-8803-1a37a8a88113 service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:21:03.543523 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347f864-33bb-47f6-8803-1a37a8a88113 service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:21:03.543789 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347f864-33bb-47f6-8803-1a37a8a88113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:21:03.554790 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347f864-33bb-47f6-8803-1a37a8a88113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:21:03.556244 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347f864-33bb-47f6-8803-1a37a8a88113 service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:21:03.565870 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 547/1104] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:21:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:21:06.036388 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3b686-2816-4c7e-82e1-6907221b6ab0 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:21:06.036871 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3b686-2816-4c7e-82e1-6907221b6ab0 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:21:06.037009 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3b686-2816-4c7e-82e1-6907221b6ab0 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:21:06.039322 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 558/1105] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:21:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:21:06.044890 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da297850-7f92-49dd-8148-1fac8208629e None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:21:06.045340 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da297850-7f92-49dd-8148-1fac8208629e None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:21:06.045443 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da297850-7f92-49dd-8148-1fac8208629e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:21:06.064816 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-da297850-7f92-49dd-8148-1fac8208629e None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:21:06.066023 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-da297850-7f92-49dd-8148-1fac8208629e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:21:06.075052 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 548/1106] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:21:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:21:06.118342 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3b686-2816-4c7e-82e1-6907221b6ab0 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:21:06.131819 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3b686-2816-4c7e-82e1-6907221b6ab0 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:21:06.136101 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feddfa9-9f30-41f5-8e61-49b5b061dfd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:21:06.136735 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feddfa9-9f30-41f5-8e61-49b5b061dfd3 service neutron] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:21:06.137009 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feddfa9-9f30-41f5-8e61-49b5b061dfd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:21:06.137278 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feddfa9-9f30-41f5-8e61-49b5b061dfd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:21:06.147306 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feddfa9-9f30-41f5-8e61-49b5b061dfd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:21:06.149029 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feddfa9-9f30-41f5-8e61-49b5b061dfd3 service neutron] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:21:06.158827 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 559/1107] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:21:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:21:08.633515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76198beb-2aa1-4132-af25-15833444f7f1 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:21:08.634112 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76198beb-2aa1-4132-af25-15833444f7f1 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:21:08.634112 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76198beb-2aa1-4132-af25-15833444f7f1 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:21:08.635480 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 549/1108] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 24 17:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:21:08.641870 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb51357-f462-4c76-98a7-1b8f6d989233 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:21:08.642348 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb51357-f462-4c76-98a7-1b8f6d989233 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:21:08.642452 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb51357-f462-4c76-98a7-1b8f6d989233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:21:08.668595 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-3fb51357-f462-4c76-98a7-1b8f6d989233 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:21:08.669781 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-3fb51357-f462-4c76-98a7-1b8f6d989233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:21:08.678765 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 560/1109] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 24 17:21:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:21:08.721844 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76198beb-2aa1-4132-af25-15833444f7f1 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:21:08.737525 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76198beb-2aa1-4132-af25-15833444f7f1 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:21:08.744780 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf74e0e-ba26-4a2a-b03a-78e47b39b55d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:21:08.745804 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf74e0e-ba26-4a2a-b03a-78e47b39b55d service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:21:08.746276 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf74e0e-ba26-4a2a-b03a-78e47b39b55d service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:21:08.746825 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf74e0e-ba26-4a2a-b03a-78e47b39b55d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:21:08.761230 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf74e0e-ba26-4a2a-b03a-78e47b39b55d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:21:08.763002 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf74e0e-ba26-4a2a-b03a-78e47b39b55d service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:21:08.772848 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 550/1110] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:21:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:21:18.662616 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=33 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:21:18.768560 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=33 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:22:54.327297 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ac3b4-215d-4a6f-a3a5-883667448c5b None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:22:54.328252 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ac3b4-215d-4a6f-a3a5-883667448c5b None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:22:54.328252 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ac3b4-215d-4a6f-a3a5-883667448c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:22:54.354021 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-8b2ac3b4-215d-4a6f-a3a5-883667448c5b None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:22:54.358871 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-8b2ac3b4-215d-4a6f-a3a5-883667448c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:22:54.371431 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 561/1111] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 24 17:22:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:22:54.379794 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026d515-2804-499a-8252-0e0a513e2b4f None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:22:54.380392 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026d515-2804-499a-8252-0e0a513e2b4f None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:22:54.380392 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026d515-2804-499a-8252-0e0a513e2b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:22:54.399135 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-3026d515-2804-499a-8252-0e0a513e2b4f None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:22:54.400577 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-3026d515-2804-499a-8252-0e0a513e2b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:22:54.408593 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 551/1112] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 24 17:22:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:22:54.413761 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ac3b4-215d-4a6f-a3a5-883667448c5b None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:22:54.426101 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ac3b4-215d-4a6f-a3a5-883667448c5b None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:22:54.433624 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98956ea-1b9a-4bde-8a0c-465a27999301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:22:54.434687 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98956ea-1b9a-4bde-8a0c-465a27999301 admin admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:22:54.435177 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98956ea-1b9a-4bde-8a0c-465a27999301 admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:22:54.435576 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98956ea-1b9a-4bde-8a0c-465a27999301 admin admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:22:54.436746 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98956ea-1b9a-4bde-8a0c-465a27999301 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:22:54.437214 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98956ea-1b9a-4bde-8a0c-465a27999301 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:22:54.438961 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: WARNING py.warnings [None req-d98956ea-1b9a-4bde-8a0c-465a27999301 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 17:22:54.438961 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: warnings.warn(msg) Jun 24 17:22:54.438961 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: Jun 24 17:22:54.440421 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98956ea-1b9a-4bde-8a0c-465a27999301 admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:22:54.455367 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 562/1113] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 24 17:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:22:54.464062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026d515-2804-499a-8252-0e0a513e2b4f None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:22:54.473815 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026d515-2804-499a-8252-0e0a513e2b4f None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:22:54.479311 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0dc765-21f3-4c8c-a2e3-28b33f5137f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:22:54.480028 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dc765-21f3-4c8c-a2e3-28b33f5137f3 admin admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:22:54.480361 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dc765-21f3-4c8c-a2e3-28b33f5137f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:22:54.480691 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dc765-21f3-4c8c-a2e3-28b33f5137f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:22:54.481430 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0dc765-21f3-4c8c-a2e3-28b33f5137f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:22:54.483378 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: WARNING py.warnings [None req-6f0dc765-21f3-4c8c-a2e3-28b33f5137f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 17:22:54.483378 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: warnings.warn(msg) Jun 24 17:22:54.483378 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: Jun 24 17:22:54.484756 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0dc765-21f3-4c8c-a2e3-28b33f5137f3 admin admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:22:54.517076 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 552/1114] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 24 17:22:54 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 17:22:54.521746 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98956ea-1b9a-4bde-8a0c-465a27999301 admin admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:22:54.532641 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98956ea-1b9a-4bde-8a0c-465a27999301 admin admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:22:54.602452 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfc75f-02c1-457b-aba8-d74fb58a0860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:22:54.603166 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfc75f-02c1-457b-aba8-d74fb58a0860 admin admin] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:22:54.603450 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfc75f-02c1-457b-aba8-d74fb58a0860 admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:22:54.603715 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfc75f-02c1-457b-aba8-d74fb58a0860 admin admin] PATH_INFO: `/v3/users` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:22:54.604403 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedfc75f-02c1-457b-aba8-d74fb58a0860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:22:54.605456 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: WARNING py.warnings [None req-fedfc75f-02c1-457b-aba8-d74fb58a0860 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 17:22:54.605456 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: warnings.warn(msg) Jun 24 17:22:54.605456 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: Jun 24 17:22:54.606646 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedfc75f-02c1-457b-aba8-d74fb58a0860 admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:22:54.636579 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 563/1115] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 24 17:22:54 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:22:54.641505 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0dc765-21f3-4c8c-a2e3-28b33f5137f3 admin admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:22:54.658524 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0dc765-21f3-4c8c-a2e3-28b33f5137f3 admin admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:22:54.666355 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc599c-e37a-42bc-8698-1742c94a7c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:22:54.667447 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc599c-e37a-42bc-8698-1742c94a7c29 admin admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:22:54.667898 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc599c-e37a-42bc-8698-1742c94a7c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:22:54.668343 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc599c-e37a-42bc-8698-1742c94a7c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:22:54.669852 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc599c-e37a-42bc-8698-1742c94a7c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:22:54.671594 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: WARNING py.warnings [None req-c9dc599c-e37a-42bc-8698-1742c94a7c29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 17:22:54.671594 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: warnings.warn(msg) Jun 24 17:22:54.671594 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: Jun 24 17:22:54.673094 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc599c-e37a-42bc-8698-1742c94a7c29 admin admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:22:54.696000 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 553/1116] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 24 17:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 17:22:54.700339 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfc75f-02c1-457b-aba8-d74fb58a0860 admin admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:22:54.712396 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfc75f-02c1-457b-aba8-d74fb58a0860 admin admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:22:54.718868 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfacaf4-19e2-4486-876a-07ca48126747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:22:54.719570 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfacaf4-19e2-4486-876a-07ca48126747 admin admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:22:54.719852 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfacaf4-19e2-4486-876a-07ca48126747 admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:22:54.720150 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfacaf4-19e2-4486-876a-07ca48126747 admin admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:22:54.720892 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfacaf4-19e2-4486-876a-07ca48126747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:22:54.721939 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: WARNING py.warnings [None req-5bfacaf4-19e2-4486-876a-07ca48126747 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 17:22:54.721939 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: warnings.warn(msg) Jun 24 17:22:54.721939 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: Jun 24 17:22:54.722862 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfacaf4-19e2-4486-876a-07ca48126747 admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:22:54.737684 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 564/1117] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 24 17:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 17:22:54.742158 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc599c-e37a-42bc-8698-1742c94a7c29 admin admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:22:54.755773 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc599c-e37a-42bc-8698-1742c94a7c29 admin admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:22:54.761536 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ae018-d066-4e8e-ac11-7693fa153122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:22:54.762428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ae018-d066-4e8e-ac11-7693fa153122 admin admin] REQUEST_METHOD: `PUT` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:22:54.762746 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ae018-d066-4e8e-ac11-7693fa153122 admin admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:22:54.763025 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ae018-d066-4e8e-ac11-7693fa153122 admin admin] PATH_INFO: `/v3/projects/e2ce0ff955ac4e11b470942c65521021/users/ca100751ffc34ef7b52ed86bb8d272a7/roles/ee8d50c25f9347d5b99d4a346f7c2fa8` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:22:54.782802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ae018-d066-4e8e-ac11-7693fa153122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ce0ff955ac4e11b470942c65521021, user_id=ca100751ffc34ef7b52ed86bb8d272a7, role_id=ee8d50c25f9347d5b99d4a346f7c2fa8)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:22:54.783890 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: WARNING py.warnings [None req-411ae018-d066-4e8e-ac11-7693fa153122 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 17:22:54.783890 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: warnings.warn(msg) Jun 24 17:22:54.783890 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: Jun 24 17:22:54.785819 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ae018-d066-4e8e-ac11-7693fa153122 admin admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:22:54.803969 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 554/1118] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 24 17:22:54 2022] PUT /identity/v3/projects/e2ce0ff955ac4e11b470942c65521021/users/ca100751ffc34ef7b52ed86bb8d272a7/roles/ee8d50c25f9347d5b99d4a346f7c2fa8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:22:54.827469 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed7c57-8510-468b-b7bf-06c38b9f0615 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:22:54.827729 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed7c57-8510-468b-b7bf-06c38b9f0615 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:22:54.827991 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed7c57-8510-468b-b7bf-06c38b9f0615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:22:54.864155 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-a3ed7c57-8510-468b-b7bf-06c38b9f0615 None None] MFA Rules not processed for user `ca100751ffc34ef7b52ed86bb8d272a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:22:54.865677 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-a3ed7c57-8510-468b-b7bf-06c38b9f0615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:22:54.951463 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 565/1119] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 24 17:22:54 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:22:54.966267 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df534258-372d-4303-8dda-7319a7bbc96e None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:22:54.966557 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df534258-372d-4303-8dda-7319a7bbc96e None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:22:54.966872 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df534258-372d-4303-8dda-7319a7bbc96e None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:22:54.968252 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 555/1120] 10.222.0.15 () {54 vars in 963 bytes} [Fri Jun 24 17:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 17:22:54.974042 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed8037-8c7c-4260-9d98-ec5b2ba413f9 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:22:54.974300 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed8037-8c7c-4260-9d98-ec5b2ba413f9 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:22:54.974609 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed8037-8c7c-4260-9d98-ec5b2ba413f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:22:54.997432 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-9fed8037-8c7c-4260-9d98-ec5b2ba413f9 None None] MFA Rules not processed for user `aa7e8d98fb4744b7af95aa93050318d4`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:22:54.998676 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-9fed8037-8c7c-4260-9d98-ec5b2ba413f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:22:55.059663 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:22:55.072996 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 566/1121] 10.222.0.15 () {58 vars in 1060 bytes} [Fri Jun 24 17:22:54 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:22:55.082387 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df534258-372d-4303-8dda-7319a7bbc96e None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:22:55.093630 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df534258-372d-4303-8dda-7319a7bbc96e None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:22:55.099193 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19920ca-94de-47ac-a8da-b0117c04f947 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa7e8d98fb4744b7af95aa93050318d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:22:55.099846 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19920ca-94de-47ac-a8da-b0117c04f947 service cinder] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:22:55.100190 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19920ca-94de-47ac-a8da-b0117c04f947 service cinder] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:22:55.100494 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19920ca-94de-47ac-a8da-b0117c04f947 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:22:55.110439 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19920ca-94de-47ac-a8da-b0117c04f947 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:22:55.111818 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19920ca-94de-47ac-a8da-b0117c04f947 service cinder] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:22:55.121436 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 556/1122] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:22:55 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:22:55.166862 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab0226-09e8-476a-8978-e4b6d357ecdc None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:22:55.167146 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab0226-09e8-476a-8978-e4b6d357ecdc None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:22:55.167418 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab0226-09e8-476a-8978-e4b6d357ecdc None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:22:55.169577 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 567/1123] 10.222.0.15 () {52 vars in 829 bytes} [Fri Jun 24 17:22:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:22:55.175748 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19920ca-94de-47ac-a8da-b0117c04f947 service cinder] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:22:55.261932 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19920ca-94de-47ac-a8da-b0117c04f947 service cinder] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:22:55.266999 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd554d67-23ff-402d-aa8e-eaf787a0554f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:22:55.267993 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd554d67-23ff-402d-aa8e-eaf787a0554f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:22:55.268304 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd554d67-23ff-402d-aa8e-eaf787a0554f admin admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:22:55.268561 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd554d67-23ff-402d-aa8e-eaf787a0554f admin admin] PATH_INFO: `/v3/users/ca100751ffc34ef7b52ed86bb8d272a7` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:22:55.269764 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd554d67-23ff-402d-aa8e-eaf787a0554f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca100751ffc34ef7b52ed86bb8d272a7)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:22:55.270885 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: WARNING py.warnings [None req-dd554d67-23ff-402d-aa8e-eaf787a0554f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 17:22:55.270885 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: warnings.warn(msg) Jun 24 17:22:55.270885 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: Jun 24 17:22:55.272121 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd554d67-23ff-402d-aa8e-eaf787a0554f admin admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:22:55.343983 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-dd554d67-23ff-402d-aa8e-eaf787a0554f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca100751ffc34ef7b52ed86bb8d272a7'} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:22:55.364439 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-dd554d67-23ff-402d-aa8e-eaf787a0554f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca100751ffc34ef7b52ed86bb8d272a7'} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:22:55.365134 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-dd554d67-23ff-402d-aa8e-eaf787a0554f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca100751ffc34ef7b52ed86bb8d272a7'} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:22:55.366028 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-dd554d67-23ff-402d-aa8e-eaf787a0554f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca100751ffc34ef7b52ed86bb8d272a7'} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:22:55.377608 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-dd554d67-23ff-402d-aa8e-eaf787a0554f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca100751ffc34ef7b52ed86bb8d272a7'} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:22:55.396319 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 557/1124] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 24 17:22:55 2022] DELETE /identity/v3/users/ca100751ffc34ef7b52ed86bb8d272a7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:22:55.401224 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53548c58-74e5-4f5e-bc8f-7204c005c88d None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:22:55.401671 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53548c58-74e5-4f5e-bc8f-7204c005c88d None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:22:55.401767 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53548c58-74e5-4f5e-bc8f-7204c005c88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:22:55.419697 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-53548c58-74e5-4f5e-bc8f-7204c005c88d None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:22:55.420892 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-53548c58-74e5-4f5e-bc8f-7204c005c88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:22:55.481316 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 568/1125] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 24 17:22:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:22:55.491732 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd554d67-23ff-402d-aa8e-eaf787a0554f admin admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:22:55.493213 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-dd554d67-23ff-402d-aa8e-eaf787a0554f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:22:55.499561 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:22:55.566550 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd554d67-23ff-402d-aa8e-eaf787a0554f admin admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:22:55.570499 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41f1b7-24d7-4641-8286-3515a057c3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:22:55.571186 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41f1b7-24d7-4641-8286-3515a057c3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:22:55.571467 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41f1b7-24d7-4641-8286-3515a057c3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:22:55.571813 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41f1b7-24d7-4641-8286-3515a057c3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:22:55.582523 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41f1b7-24d7-4641-8286-3515a057c3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:22:55.584009 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41f1b7-24d7-4641-8286-3515a057c3f3 service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:22:55.594497 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 558/1126] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:22:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:22:55.965319 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53548c58-74e5-4f5e-bc8f-7204c005c88d None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:22:55.967373 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-53548c58-74e5-4f5e-bc8f-7204c005c88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:22:55.987657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53548c58-74e5-4f5e-bc8f-7204c005c88d None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:22:55.995406 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b438d3-630f-4c6d-a395-7a71d130e381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:22:55.996670 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b438d3-630f-4c6d-a395-7a71d130e381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:22:55.997069 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b438d3-630f-4c6d-a395-7a71d130e381 admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:22:55.998049 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b438d3-630f-4c6d-a395-7a71d130e381 admin admin] PATH_INFO: `/v3/projects/e2ce0ff955ac4e11b470942c65521021` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:22:55.999808 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b438d3-630f-4c6d-a395-7a71d130e381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2ce0ff955ac4e11b470942c65521021)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:22:56.001661 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: WARNING py.warnings [None req-57b438d3-630f-4c6d-a395-7a71d130e381 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 17:22:56.001661 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: warnings.warn(msg) Jun 24 17:22:56.001661 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: Jun 24 17:22:56.003955 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b438d3-630f-4c6d-a395-7a71d130e381 admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:22:56.081804 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-57b438d3-630f-4c6d-a395-7a71d130e381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ce0ff955ac4e11b470942c65521021', 'request_id': 'req-57b438d3-630f-4c6d-a395-7a71d130e381'} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:22:56.087977 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-57b438d3-630f-4c6d-a395-7a71d130e381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ce0ff955ac4e11b470942c65521021', 'request_id': 'req-57b438d3-630f-4c6d-a395-7a71d130e381'} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:22:56.098163 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-57b438d3-630f-4c6d-a395-7a71d130e381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ce0ff955ac4e11b470942c65521021', 'request_id': 'req-57b438d3-630f-4c6d-a395-7a71d130e381'} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:22:56.117146 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-57b438d3-630f-4c6d-a395-7a71d130e381 admin admin] The token cache is being invalidate because project e2ce0ff955ac4e11b470942c65521021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87096) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 17:22:56.117393 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-57b438d3-630f-4c6d-a395-7a71d130e381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:22:56.118099 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-57b438d3-630f-4c6d-a395-7a71d130e381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:22:56.120103 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 569/1127] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 24 17:22:55 2022] DELETE /identity/v3/projects/e2ce0ff955ac4e11b470942c65521021 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:23:05.590108 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=25 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:23:06.113883 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:24:18.743222 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793ffe3-d166-45e6-8b20-3db63a79cf5a None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:18.743995 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793ffe3-d166-45e6-8b20-3db63a79cf5a None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:18.744104 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793ffe3-d166-45e6-8b20-3db63a79cf5a None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:18.745520 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 559/1128] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 17:24:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:24:18.751904 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3c9ed-08d1-4f19-a309-86b20c55637a None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:18.752482 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3c9ed-08d1-4f19-a309-86b20c55637a None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:18.752755 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3c9ed-08d1-4f19-a309-86b20c55637a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:18.849891 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-beb3c9ed-08d1-4f19-a309-86b20c55637a None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:24:18.851129 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-beb3c9ed-08d1-4f19-a309-86b20c55637a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:24:18.961523 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 570/1129] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 17:24:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:24:19.124647 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793ffe3-d166-45e6-8b20-3db63a79cf5a None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:24:19.126712 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-1793ffe3-d166-45e6-8b20-3db63a79cf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:24:19.228274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793ffe3-d166-45e6-8b20-3db63a79cf5a None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:24:19.233578 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4cde3-4393-40aa-9d6e-3c4d494cdd3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:24:19.234236 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4cde3-4393-40aa-9d6e-3c4d494cdd3e service nova] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:19.234509 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4cde3-4393-40aa-9d6e-3c4d494cdd3e service nova] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:19.234818 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4cde3-4393-40aa-9d6e-3c4d494cdd3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:19.243838 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4cde3-4393-40aa-9d6e-3c4d494cdd3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:24:19.245584 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4cde3-4393-40aa-9d6e-3c4d494cdd3e service nova] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:24:19.255671 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 560/1130] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:24:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:24:20.113885 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342cbda-554a-4f07-8681-344f3b97fbd3 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:20.114447 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342cbda-554a-4f07-8681-344f3b97fbd3 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:20.114447 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342cbda-554a-4f07-8681-344f3b97fbd3 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:20.115826 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 571/1131] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 17:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:24:20.121202 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7947ede-2e07-418e-8ad6-51d79b122a58 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:20.121703 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7947ede-2e07-418e-8ad6-51d79b122a58 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:20.121809 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7947ede-2e07-418e-8ad6-51d79b122a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:20.141578 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-a7947ede-2e07-418e-8ad6-51d79b122a58 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:24:20.142827 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-a7947ede-2e07-418e-8ad6-51d79b122a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:24:20.151306 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 561/1132] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 17:24:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:24:20.319655 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342cbda-554a-4f07-8681-344f3b97fbd3 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:24:20.338946 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342cbda-554a-4f07-8681-344f3b97fbd3 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:24:20.345510 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932a1c5-8540-40ac-9084-5646c19ea083 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:24:20.346190 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932a1c5-8540-40ac-9084-5646c19ea083 service nova] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:20.346452 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932a1c5-8540-40ac-9084-5646c19ea083 service nova] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:20.346756 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932a1c5-8540-40ac-9084-5646c19ea083 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:20.356349 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932a1c5-8540-40ac-9084-5646c19ea083 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:24:20.357971 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932a1c5-8540-40ac-9084-5646c19ea083 service nova] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:24:20.369220 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 572/1133] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:24:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:24:24.875243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810a5be-af13-4451-8e8f-fe2aa16068d0 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:24.875842 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810a5be-af13-4451-8e8f-fe2aa16068d0 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:24.875842 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810a5be-af13-4451-8e8f-fe2aa16068d0 None None] PATH_INFO: `/v3` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:24.877072 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 562/1134] 10.222.0.59 () {54 vars in 925 bytes} [Fri Jun 24 17:24:24 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:24:24.896033 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f042a6-6a89-4506-ae0d-bf270bde301e None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:24.896458 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f042a6-6a89-4506-ae0d-bf270bde301e None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:24.896550 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f042a6-6a89-4506-ae0d-bf270bde301e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:24.928322 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-50f042a6-6a89-4506-ae0d-bf270bde301e None None] MFA Rules not processed for user `b318b7cfb1c5485cba96997ddd73945c`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:24:24.929532 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-50f042a6-6a89-4506-ae0d-bf270bde301e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:24:24.987591 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=100 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:24:25.002549 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 573/1135] 10.222.0.59 () {58 vars in 1015 bytes} [Fri Jun 24 17:24:24 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:24:30.136533 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=42 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:24:31.639924 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe90b5-62a1-4349-ab48-cd37170357bd None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:31.640522 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe90b5-62a1-4349-ab48-cd37170357bd None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:31.640522 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe90b5-62a1-4349-ab48-cd37170357bd None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:31.641830 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 563/1136] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 17:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:24:31.647705 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415076a-57d6-44f2-9020-1d75ec0b3353 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:31.648542 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415076a-57d6-44f2-9020-1d75ec0b3353 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:31.648542 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415076a-57d6-44f2-9020-1d75ec0b3353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:31.672027 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-f415076a-57d6-44f2-9020-1d75ec0b3353 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:24:31.673240 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-f415076a-57d6-44f2-9020-1d75ec0b3353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:24:31.682055 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 574/1137] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 17:24:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:24:31.868005 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe90b5-62a1-4349-ab48-cd37170357bd None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:24:31.890673 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe90b5-62a1-4349-ab48-cd37170357bd None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:24:31.899923 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da70e3f-e75b-4189-ab57-7decbbdc9c33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:24:31.900994 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da70e3f-e75b-4189-ab57-7decbbdc9c33 service nova] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:31.901482 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da70e3f-e75b-4189-ab57-7decbbdc9c33 service nova] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:31.901911 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da70e3f-e75b-4189-ab57-7decbbdc9c33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:31.915654 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da70e3f-e75b-4189-ab57-7decbbdc9c33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:24:31.918530 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da70e3f-e75b-4189-ab57-7decbbdc9c33 service nova] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:24:31.934534 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 564/1138] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:24:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:24:32.831079 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0177b9-6b03-4432-91e0-3e92fd41eb95 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:32.831728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0177b9-6b03-4432-91e0-3e92fd41eb95 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:32.831728 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0177b9-6b03-4432-91e0-3e92fd41eb95 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:32.833001 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 575/1139] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 17:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:24:32.838475 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e717cf-e3bc-4770-9cba-9242628ac23b None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:32.839026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e717cf-e3bc-4770-9cba-9242628ac23b None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:32.839026 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e717cf-e3bc-4770-9cba-9242628ac23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:32.857315 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-d9e717cf-e3bc-4770-9cba-9242628ac23b None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:24:32.858527 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-d9e717cf-e3bc-4770-9cba-9242628ac23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:24:32.866546 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 565/1140] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 17:24:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 17:24:33.024989 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0177b9-6b03-4432-91e0-3e92fd41eb95 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:24:33.041801 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0177b9-6b03-4432-91e0-3e92fd41eb95 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:24:33.059827 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408a722-55ea-4a10-bcdb-24a47dbe5070 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:24:33.060488 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408a722-55ea-4a10-bcdb-24a47dbe5070 service nova] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:33.060754 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408a722-55ea-4a10-bcdb-24a47dbe5070 service nova] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:33.061001 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408a722-55ea-4a10-bcdb-24a47dbe5070 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:33.070847 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408a722-55ea-4a10-bcdb-24a47dbe5070 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:24:33.073474 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408a722-55ea-4a10-bcdb-24a47dbe5070 service nova] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:24:33.084417 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 576/1141] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:24:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:24:34.347273 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454af497-1066-44d4-ba94-16f3cc83e93e None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:34.347895 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454af497-1066-44d4-ba94-16f3cc83e93e None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:34.347895 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454af497-1066-44d4-ba94-16f3cc83e93e None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:34.349063 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 566/1142] 10.222.0.15 () {54 vars in 960 bytes} [Fri Jun 24 17:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:24:34.355424 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c91cf1-73a6-4ce2-b191-e438a44d71f0 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:34.355424 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c91cf1-73a6-4ce2-b191-e438a44d71f0 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:34.355424 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c91cf1-73a6-4ce2-b191-e438a44d71f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:34.375348 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-a1c91cf1-73a6-4ce2-b191-e438a44d71f0 None None] MFA Rules not processed for user `b318b7cfb1c5485cba96997ddd73945c`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:24:34.376573 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-a1c91cf1-73a6-4ce2-b191-e438a44d71f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:24:34.386554 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 577/1143] 10.222.0.15 () {58 vars in 1057 bytes} [Fri Jun 24 17:24:34 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 17:24:34.395719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454af497-1066-44d4-ba94-16f3cc83e93e None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:24:34.419091 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454af497-1066-44d4-ba94-16f3cc83e93e None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:24:34.426059 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bee6e6-b35e-48e1-abfa-36aded7b2f10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b318b7cfb1c5485cba96997ddd73945c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:24:34.426901 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bee6e6-b35e-48e1-abfa-36aded7b2f10 service placement] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:34.427231 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bee6e6-b35e-48e1-abfa-36aded7b2f10 service placement] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:34.427505 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bee6e6-b35e-48e1-abfa-36aded7b2f10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:34.438730 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bee6e6-b35e-48e1-abfa-36aded7b2f10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:24:34.440348 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bee6e6-b35e-48e1-abfa-36aded7b2f10 service placement] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:24:34.452122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 567/1144] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:24:34 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 17:24:44.369553 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=12 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:24:44.388098 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0deb9a9-e3f2-415a-99da-9b752d636a62 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:44.388464 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0deb9a9-e3f2-415a-99da-9b752d636a62 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:44.388719 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0deb9a9-e3f2-415a-99da-9b752d636a62 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:44.390129 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 578/1145] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 17:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:24:44.395211 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1107c-6d96-4eba-b2c0-b417ecadac0e None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:44.395692 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1107c-6d96-4eba-b2c0-b417ecadac0e None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:44.395821 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1107c-6d96-4eba-b2c0-b417ecadac0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:44.415141 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-84f1107c-6d96-4eba-b2c0-b417ecadac0e None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:24:44.416575 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-84f1107c-6d96-4eba-b2c0-b417ecadac0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:24:44.426029 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 568/1146] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 17:24:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:24:44.588229 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0deb9a9-e3f2-415a-99da-9b752d636a62 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:24:44.602285 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0deb9a9-e3f2-415a-99da-9b752d636a62 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:24:44.607701 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effab83-a05e-4bf5-953e-0ef8d97e0978 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:24:44.608336 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effab83-a05e-4bf5-953e-0ef8d97e0978 service nova] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:44.608612 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effab83-a05e-4bf5-953e-0ef8d97e0978 service nova] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:44.608971 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effab83-a05e-4bf5-953e-0ef8d97e0978 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:44.617904 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effab83-a05e-4bf5-953e-0ef8d97e0978 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:24:44.619822 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effab83-a05e-4bf5-953e-0ef8d97e0978 service nova] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:24:44.630294 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 579/1147] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:24:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:24:45.470053 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368d33e-7eb4-4f03-a735-613182ba31c1 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:45.470562 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368d33e-7eb4-4f03-a735-613182ba31c1 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:45.470751 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368d33e-7eb4-4f03-a735-613182ba31c1 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:45.472983 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 569/1148] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 17:24:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:24:45.477782 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6f9ef-04fb-44c3-bcf3-90f385702005 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:45.478242 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6f9ef-04fb-44c3-bcf3-90f385702005 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:45.478363 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6f9ef-04fb-44c3-bcf3-90f385702005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:45.497790 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-f4b6f9ef-04fb-44c3-bcf3-90f385702005 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:24:45.499053 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-f4b6f9ef-04fb-44c3-bcf3-90f385702005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:24:45.508563 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 580/1149] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 17:24:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:24:45.668737 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368d33e-7eb4-4f03-a735-613182ba31c1 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:24:45.684910 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368d33e-7eb4-4f03-a735-613182ba31c1 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:24:45.691297 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add95955-0be7-4e3c-8b98-f0eed29d847c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:24:45.691925 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add95955-0be7-4e3c-8b98-f0eed29d847c service nova] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:45.692201 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add95955-0be7-4e3c-8b98-f0eed29d847c service nova] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:45.692475 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add95955-0be7-4e3c-8b98-f0eed29d847c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:45.701864 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add95955-0be7-4e3c-8b98-f0eed29d847c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:24:45.703514 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add95955-0be7-4e3c-8b98-f0eed29d847c service nova] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:24:45.713520 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 570/1150] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:24:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:24:49.933284 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57c8e9-7e94-4865-8eb6-bb1819124d46 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:49.933904 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57c8e9-7e94-4865-8eb6-bb1819124d46 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:49.933904 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57c8e9-7e94-4865-8eb6-bb1819124d46 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:49.935711 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 581/1151] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 17:24:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:24:49.947658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56010232-301f-4ab7-84b4-e8dc963d0f0a None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:49.948513 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56010232-301f-4ab7-84b4-e8dc963d0f0a None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:49.948694 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56010232-301f-4ab7-84b4-e8dc963d0f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:49.969566 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-56010232-301f-4ab7-84b4-e8dc963d0f0a None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:24:49.970858 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-56010232-301f-4ab7-84b4-e8dc963d0f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:24:49.979205 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 571/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 17:24:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:24:50.020541 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57c8e9-7e94-4865-8eb6-bb1819124d46 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:24:50.022721 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-8c57c8e9-7e94-4865-8eb6-bb1819124d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:24:50.110094 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57c8e9-7e94-4865-8eb6-bb1819124d46 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:24:50.114128 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7f7c7-286c-4a03-b67f-37b0b6d85129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:24:50.114793 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7f7c7-286c-4a03-b67f-37b0b6d85129 service neutron] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:50.115066 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7f7c7-286c-4a03-b67f-37b0b6d85129 service neutron] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:50.115337 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7f7c7-286c-4a03-b67f-37b0b6d85129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:50.125359 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7f7c7-286c-4a03-b67f-37b0b6d85129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:24:50.126858 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7f7c7-286c-4a03-b67f-37b0b6d85129 service neutron] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:24:50.137752 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 582/1153] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:24:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:24:52.447006 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccac3c-c05c-4355-93f8-289bdb009edf None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:52.447603 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccac3c-c05c-4355-93f8-289bdb009edf None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:52.447603 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccac3c-c05c-4355-93f8-289bdb009edf None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:52.448913 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 572/1154] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 17:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:24:52.454543 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0ff5c-895a-418f-9560-97dcd8e60905 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:52.455284 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0ff5c-895a-418f-9560-97dcd8e60905 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:52.455471 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0ff5c-895a-418f-9560-97dcd8e60905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:52.480149 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-9db0ff5c-895a-418f-9560-97dcd8e60905 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:24:52.481364 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-9db0ff5c-895a-418f-9560-97dcd8e60905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:24:52.490022 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 583/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 17:24:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:24:52.532234 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccac3c-c05c-4355-93f8-289bdb009edf None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:24:52.535147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-b6ccac3c-c05c-4355-93f8-289bdb009edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:24:52.551734 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccac3c-c05c-4355-93f8-289bdb009edf None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:24:52.556229 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45cbba-e9a3-4137-971e-72b3ad706391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:24:52.556868 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45cbba-e9a3-4137-971e-72b3ad706391 service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:52.557163 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45cbba-e9a3-4137-971e-72b3ad706391 service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:52.557436 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45cbba-e9a3-4137-971e-72b3ad706391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:52.567867 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45cbba-e9a3-4137-971e-72b3ad706391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:24:52.569326 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45cbba-e9a3-4137-971e-72b3ad706391 service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:24:52.579853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 573/1156] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:24:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:24:56.449482 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48ab0d-447e-4464-804d-ed931ca1139a None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:56.450043 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48ab0d-447e-4464-804d-ed931ca1139a None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:56.450043 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48ab0d-447e-4464-804d-ed931ca1139a None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:56.451384 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 584/1157] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 17:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:24:56.457084 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21e14e-0170-47de-8e69-b60050f40298 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:56.457553 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21e14e-0170-47de-8e69-b60050f40298 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:56.457659 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21e14e-0170-47de-8e69-b60050f40298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:56.477769 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-ae21e14e-0170-47de-8e69-b60050f40298 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:24:56.480729 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-ae21e14e-0170-47de-8e69-b60050f40298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:24:56.488335 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 574/1158] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 17:24:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:24:56.761943 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48ab0d-447e-4464-804d-ed931ca1139a None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:24:56.763834 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-ca48ab0d-447e-4464-804d-ed931ca1139a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:24:56.841079 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48ab0d-447e-4464-804d-ed931ca1139a None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:24:56.844813 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67114a01-c000-44ea-9e48-3289aae84ece service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa7e8d98fb4744b7af95aa93050318d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:24:56.845465 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67114a01-c000-44ea-9e48-3289aae84ece service cinder] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:56.845743 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67114a01-c000-44ea-9e48-3289aae84ece service cinder] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:56.846013 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67114a01-c000-44ea-9e48-3289aae84ece service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:56.856263 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67114a01-c000-44ea-9e48-3289aae84ece service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:24:56.857720 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67114a01-c000-44ea-9e48-3289aae84ece service cinder] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:24:56.867555 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 585/1159] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:24:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:24:59.243583 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476aeee2-b9b1-4d47-a5c6-e91d8bf13fbd None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:59.244155 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476aeee2-b9b1-4d47-a5c6-e91d8bf13fbd None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:59.244155 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476aeee2-b9b1-4d47-a5c6-e91d8bf13fbd None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:59.245663 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 575/1160] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 17:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:24:59.251242 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e8e9f-af5c-4178-b2c8-6e6a158d8b7a None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:59.251897 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e8e9f-af5c-4178-b2c8-6e6a158d8b7a None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:59.251897 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e8e9f-af5c-4178-b2c8-6e6a158d8b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:59.271962 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-b29e8e9f-af5c-4178-b2c8-6e6a158d8b7a None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:24:59.273024 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-b29e8e9f-af5c-4178-b2c8-6e6a158d8b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:24:59.282325 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 586/1161] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 17:24:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:24:59.567602 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476aeee2-b9b1-4d47-a5c6-e91d8bf13fbd None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:24:59.569494 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-476aeee2-b9b1-4d47-a5c6-e91d8bf13fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:24:59.586647 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476aeee2-b9b1-4d47-a5c6-e91d8bf13fbd None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:24:59.589486 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f8f1c-1fae-4664-9abd-7071f87ed8a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa7e8d98fb4744b7af95aa93050318d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:24:59.590119 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f8f1c-1fae-4664-9abd-7071f87ed8a9 service cinder] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:24:59.590395 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f8f1c-1fae-4664-9abd-7071f87ed8a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:24:59.590715 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f8f1c-1fae-4664-9abd-7071f87ed8a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:24:59.600912 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f8f1c-1fae-4664-9abd-7071f87ed8a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:24:59.602428 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f8f1c-1fae-4664-9abd-7071f87ed8a9 service cinder] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:24:59.612699 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 576/1162] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:24:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 17:25:09.266105 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=77 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:25:09.608170 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=42 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:26:19.498377 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fd1e2-2db2-405a-93b4-e74b0a460086 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:19.499148 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fd1e2-2db2-405a-93b4-e74b0a460086 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:19.499148 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fd1e2-2db2-405a-93b4-e74b0a460086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:19.507562 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622261be-3402-4834-9d6c-da8611898d09 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:19.508155 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622261be-3402-4834-9d6c-da8611898d09 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:19.508155 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622261be-3402-4834-9d6c-da8611898d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:19.518124 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-6d1fd1e2-2db2-405a-93b4-e74b0a460086 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:26:19.519427 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-6d1fd1e2-2db2-405a-93b4-e74b0a460086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:26:19.527616 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-622261be-3402-4834-9d6c-da8611898d09 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:26:19.529210 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-622261be-3402-4834-9d6c-da8611898d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:26:19.532542 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 587/1163] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 24 17:26:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:26:19.537136 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 577/1164] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 24 17:26:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:26:19.540991 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c922e0a-03f5-490e-829e-ceb516ed56d3 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:19.541276 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c922e0a-03f5-490e-829e-ceb516ed56d3 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:19.541555 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c922e0a-03f5-490e-829e-ceb516ed56d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:19.545517 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc3143-e6bb-4bef-8785-049bda6be0c1 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:19.545797 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc3143-e6bb-4bef-8785-049bda6be0c1 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:19.546071 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc3143-e6bb-4bef-8785-049bda6be0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:19.565205 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-6c922e0a-03f5-490e-829e-ceb516ed56d3 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:26:19.565470 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-bacc3143-e6bb-4bef-8785-049bda6be0c1 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:26:19.566401 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-6c922e0a-03f5-490e-829e-ceb516ed56d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:26:19.566532 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-bacc3143-e6bb-4bef-8785-049bda6be0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:26:19.575151 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 588/1165] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 24 17:26:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:26:19.576605 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 578/1166] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 24 17:26:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:26:19.579763 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c922e0a-03f5-490e-829e-ceb516ed56d3 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:19.584471 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc3143-e6bb-4bef-8785-049bda6be0c1 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:19.590473 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c922e0a-03f5-490e-829e-ceb516ed56d3 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:19.595556 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc3143-e6bb-4bef-8785-049bda6be0c1 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:19.596692 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40aafa8-ffa4-49f5-9557-9cc7bd7b504a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:19.597304 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40aafa8-ffa4-49f5-9557-9cc7bd7b504a admin admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:19.597576 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40aafa8-ffa4-49f5-9557-9cc7bd7b504a admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:19.597845 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40aafa8-ffa4-49f5-9557-9cc7bd7b504a admin admin] PATH_INFO: `/v3/domains` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:19.598579 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40aafa8-ffa4-49f5-9557-9cc7bd7b504a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87096) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:26:19.598898 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40aafa8-ffa4-49f5-9557-9cc7bd7b504a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:19.600170 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df0809-d0a6-4b02-ada5-5f67252ad222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:19.600523 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40aafa8-ffa4-49f5-9557-9cc7bd7b504a admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:19.600827 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df0809-d0a6-4b02-ada5-5f67252ad222 admin admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:19.601101 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df0809-d0a6-4b02-ada5-5f67252ad222 admin admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:19.601369 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df0809-d0a6-4b02-ada5-5f67252ad222 admin admin] PATH_INFO: `/v3/domains` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:19.602095 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df0809-d0a6-4b02-ada5-5f67252ad222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 17:26:19.602412 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df0809-d0a6-4b02-ada5-5f67252ad222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:19.603852 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: WARNING py.warnings [None req-81df0809-d0a6-4b02-ada5-5f67252ad222 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 17:26:19.603852 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: warnings.warn(msg) Jun 24 17:26:19.603852 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: Jun 24 17:26:19.604614 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df0809-d0a6-4b02-ada5-5f67252ad222 admin admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:19.614423 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 589/1167] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 24 17:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:26:19.617047 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 579/1168] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 24 17:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 17:26:19.623129 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40aafa8-ffa4-49f5-9557-9cc7bd7b504a admin admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:19.625320 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df0809-d0a6-4b02-ada5-5f67252ad222 admin admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:19.633734 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40aafa8-ffa4-49f5-9557-9cc7bd7b504a admin admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:19.635571 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df0809-d0a6-4b02-ada5-5f67252ad222 admin admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:19.638792 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbe42f-6415-47fd-a17a-96adf872c129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:19.639496 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbe42f-6415-47fd-a17a-96adf872c129 admin admin] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:19.639738 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbe42f-6415-47fd-a17a-96adf872c129 admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:19.639947 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc807a-8f2c-4413-8bba-1ddec94b3ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:19.640062 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbe42f-6415-47fd-a17a-96adf872c129 admin admin] PATH_INFO: `/v3/projects` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:19.640610 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc807a-8f2c-4413-8bba-1ddec94b3ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:19.640710 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbe42f-6415-47fd-a17a-96adf872c129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:19.640891 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc807a-8f2c-4413-8bba-1ddec94b3ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:19.641265 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc807a-8f2c-4413-8bba-1ddec94b3ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:19.641708 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: WARNING py.warnings [None req-fccbe42f-6415-47fd-a17a-96adf872c129 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 17:26:19.641708 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: warnings.warn(msg) Jun 24 17:26:19.641708 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: Jun 24 17:26:19.642002 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc807a-8f2c-4413-8bba-1ddec94b3ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:19.642933 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbe42f-6415-47fd-a17a-96adf872c129 admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:19.643915 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc807a-8f2c-4413-8bba-1ddec94b3ee5 admin admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:19.688980 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 580/1169] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 24 17:26:19 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 17:26:19.690190 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc807a-8f2c-4413-8bba-1ddec94b3ee5 admin admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:19.694527 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 590/1170] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 24 17:26:19 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:26:19.695575 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbe42f-6415-47fd-a17a-96adf872c129 admin admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:19.766918 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc807a-8f2c-4413-8bba-1ddec94b3ee5 admin admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:19.771595 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec574f9c-e966-4497-b493-b963e6eed6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:19.771819 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbe42f-6415-47fd-a17a-96adf872c129 admin admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:19.772274 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec574f9c-e966-4497-b493-b963e6eed6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:19.772548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec574f9c-e966-4497-b493-b963e6eed6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:19.772822 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec574f9c-e966-4497-b493-b963e6eed6c9 admin admin] PATH_INFO: `/v3/users` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:19.773515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec574f9c-e966-4497-b493-b963e6eed6c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:19.774537 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: WARNING py.warnings [None req-ec574f9c-e966-4497-b493-b963e6eed6c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 17:26:19.774537 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: warnings.warn(msg) Jun 24 17:26:19.774537 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: Jun 24 17:26:19.775774 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec574f9c-e966-4497-b493-b963e6eed6c9 admin admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:19.777004 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a2857-1846-463e-ae75-afb986e4d609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:19.777381 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a2857-1846-463e-ae75-afb986e4d609 admin admin] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:19.777655 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a2857-1846-463e-ae75-afb986e4d609 admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:19.777971 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a2857-1846-463e-ae75-afb986e4d609 admin admin] PATH_INFO: `/v3/users` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:19.778848 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a2857-1846-463e-ae75-afb986e4d609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:19.780791 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a2857-1846-463e-ae75-afb986e4d609 admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:19.808262 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 581/1171] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 24 17:26:19 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:26:19.808492 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 591/1172] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 24 17:26:19 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 17:26:19.809458 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec574f9c-e966-4497-b493-b963e6eed6c9 admin admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:19.811168 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a2857-1846-463e-ae75-afb986e4d609 admin admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:19.823737 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a2857-1846-463e-ae75-afb986e4d609 admin admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:19.824002 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec574f9c-e966-4497-b493-b963e6eed6c9 admin admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:19.827153 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431355d-3379-4998-8c87-4a9b2b8e2d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:19.827835 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431355d-3379-4998-8c87-4a9b2b8e2d1c admin admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:19.828109 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431355d-3379-4998-8c87-4a9b2b8e2d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:19.828378 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431355d-3379-4998-8c87-4a9b2b8e2d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:19.828751 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0777fd1-9d99-4407-81f8-a3f790f71f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:19.829166 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431355d-3379-4998-8c87-4a9b2b8e2d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:19.829440 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0777fd1-9d99-4407-81f8-a3f790f71f6f admin admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:19.829712 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0777fd1-9d99-4407-81f8-a3f790f71f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:19.829980 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0777fd1-9d99-4407-81f8-a3f790f71f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:19.830784 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431355d-3379-4998-8c87-4a9b2b8e2d1c admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:19.830896 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0777fd1-9d99-4407-81f8-a3f790f71f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:19.832482 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0777fd1-9d99-4407-81f8-a3f790f71f6f admin admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:19.842135 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 592/1173] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 24 17:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 17:26:19.843842 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 582/1174] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 24 17:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 17:26:19.848396 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431355d-3379-4998-8c87-4a9b2b8e2d1c admin admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:19.848736 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0777fd1-9d99-4407-81f8-a3f790f71f6f admin admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:19.861863 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431355d-3379-4998-8c87-4a9b2b8e2d1c admin admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:19.863363 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0777fd1-9d99-4407-81f8-a3f790f71f6f admin admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:19.866661 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fe6e1-7e5e-4c5d-bba4-a1ad2dac5862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:19.867316 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fe6e1-7e5e-4c5d-bba4-a1ad2dac5862 admin admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:19.867597 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fe6e1-7e5e-4c5d-bba4-a1ad2dac5862 admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:19.867872 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fe6e1-7e5e-4c5d-bba4-a1ad2dac5862 admin admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:19.868187 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5380de-ffa9-4f9f-b324-2b3dd2b466c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:19.868591 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fe6e1-7e5e-4c5d-bba4-a1ad2dac5862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:19.868912 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5380de-ffa9-4f9f-b324-2b3dd2b466c2 admin admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:19.869196 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5380de-ffa9-4f9f-b324-2b3dd2b466c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:19.869470 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5380de-ffa9-4f9f-b324-2b3dd2b466c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:19.870218 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fe6e1-7e5e-4c5d-bba4-a1ad2dac5862 admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:19.870346 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5380de-ffa9-4f9f-b324-2b3dd2b466c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:19.872196 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5380de-ffa9-4f9f-b324-2b3dd2b466c2 admin admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:19.881318 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 593/1175] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 24 17:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 17:26:19.885262 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 583/1176] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 24 17:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 17:26:19.885717 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fe6e1-7e5e-4c5d-bba4-a1ad2dac5862 admin admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:19.890220 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5380de-ffa9-4f9f-b324-2b3dd2b466c2 admin admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:19.896211 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fe6e1-7e5e-4c5d-bba4-a1ad2dac5862 admin admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:19.901078 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65facd2-7c8c-4be8-9bce-7c70fda3d823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:19.901973 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65facd2-7c8c-4be8-9bce-7c70fda3d823 admin admin] REQUEST_METHOD: `PUT` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:19.902085 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5380de-ffa9-4f9f-b324-2b3dd2b466c2 admin admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:19.902252 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65facd2-7c8c-4be8-9bce-7c70fda3d823 admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:19.902523 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65facd2-7c8c-4be8-9bce-7c70fda3d823 admin admin] PATH_INFO: `/v3/projects/207704ad3e894c26b00504c28704adb3/users/66beb08e5cb24d57aa4b41137cf3d649/roles/ee8d50c25f9347d5b99d4a346f7c2fa8` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:19.908261 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa808d-2077-4bfa-8f16-af6877284016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:19.909171 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa808d-2077-4bfa-8f16-af6877284016 admin admin] REQUEST_METHOD: `PUT` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:19.909452 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa808d-2077-4bfa-8f16-af6877284016 admin admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:19.909749 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa808d-2077-4bfa-8f16-af6877284016 admin admin] PATH_INFO: `/v3/projects/d4345a67dda74a15a91474518cb7935f/users/315a0525be7d48c1ab11ba23499e6ce3/roles/ee8d50c25f9347d5b99d4a346f7c2fa8` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:19.919387 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65facd2-7c8c-4be8-9bce-7c70fda3d823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=207704ad3e894c26b00504c28704adb3, user_id=66beb08e5cb24d57aa4b41137cf3d649, role_id=ee8d50c25f9347d5b99d4a346f7c2fa8)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:19.920253 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: WARNING py.warnings [None req-e65facd2-7c8c-4be8-9bce-7c70fda3d823 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 17:26:19.920253 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: warnings.warn(msg) Jun 24 17:26:19.920253 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: Jun 24 17:26:19.922532 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65facd2-7c8c-4be8-9bce-7c70fda3d823 admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:19.927976 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa808d-2077-4bfa-8f16-af6877284016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4345a67dda74a15a91474518cb7935f, user_id=315a0525be7d48c1ab11ba23499e6ce3, role_id=ee8d50c25f9347d5b99d4a346f7c2fa8)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:19.931100 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa808d-2077-4bfa-8f16-af6877284016 admin admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:19.939584 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 594/1177] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 24 17:26:19 2022] PUT /identity/v3/projects/207704ad3e894c26b00504c28704adb3/users/66beb08e5cb24d57aa4b41137cf3d649/roles/ee8d50c25f9347d5b99d4a346f7c2fa8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 17:26:19.946451 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175c09f-f83f-4e7f-a671-327da3fa44b1 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:19.946834 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175c09f-f83f-4e7f-a671-327da3fa44b1 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:19.947161 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175c09f-f83f-4e7f-a671-327da3fa44b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:19.953254 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 584/1178] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 24 17:26:19 2022] PUT /identity/v3/projects/d4345a67dda74a15a91474518cb7935f/users/315a0525be7d48c1ab11ba23499e6ce3/roles/ee8d50c25f9347d5b99d4a346f7c2fa8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:26:19.955842 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52320e80-baa4-4a78-8434-83ffad58b8b0 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:19.956196 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52320e80-baa4-4a78-8434-83ffad58b8b0 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:19.956548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52320e80-baa4-4a78-8434-83ffad58b8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:19.968790 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-8175c09f-f83f-4e7f-a671-327da3fa44b1 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:26:19.970004 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-8175c09f-f83f-4e7f-a671-327da3fa44b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:26:19.975478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-52320e80-baa4-4a78-8434-83ffad58b8b0 None None] MFA Rules not processed for user `f9689251030946e8ba0417a0a5385957`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:26:19.977106 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-52320e80-baa4-4a78-8434-83ffad58b8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:26:20.014050 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:26:20.042229 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:26:20.044751 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 595/1179] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 24 17:26:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 17:26:20.057151 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175c09f-f83f-4e7f-a671-327da3fa44b1 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:20.069501 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 585/1180] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 24 17:26:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:26:20.079584 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52320e80-baa4-4a78-8434-83ffad58b8b0 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:20.123697 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175c09f-f83f-4e7f-a671-327da3fa44b1 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:20.129579 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10916d-ab05-4f38-a628-af51770aa530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:20.130281 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10916d-ab05-4f38-a628-af51770aa530 service neutron] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:20.130551 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10916d-ab05-4f38-a628-af51770aa530 service neutron] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:20.130829 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10916d-ab05-4f38-a628-af51770aa530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:20.141492 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10916d-ab05-4f38-a628-af51770aa530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:20.142997 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10916d-ab05-4f38-a628-af51770aa530 service neutron] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:20.148217 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52320e80-baa4-4a78-8434-83ffad58b8b0 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:20.152243 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aeb875-8e62-4251-b773-224e6f460b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:20.152866 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 596/1181] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:26:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 17:26:20.153053 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aeb875-8e62-4251-b773-224e6f460b95 service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:20.153403 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aeb875-8e62-4251-b773-224e6f460b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:20.153671 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aeb875-8e62-4251-b773-224e6f460b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:20.164872 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aeb875-8e62-4251-b773-224e6f460b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:20.166363 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aeb875-8e62-4251-b773-224e6f460b95 service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:20.178468 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 586/1182] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:26:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:26:26.249467 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecfa12-c0c7-462e-a156-c858dac6de2c None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:26.250055 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecfa12-c0c7-462e-a156-c858dac6de2c None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:26.250055 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecfa12-c0c7-462e-a156-c858dac6de2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:26.315798 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-08ecfa12-c0c7-462e-a156-c858dac6de2c None None] MFA Rules not processed for user `66beb08e5cb24d57aa4b41137cf3d649`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:26:26.317035 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-08ecfa12-c0c7-462e-a156-c858dac6de2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:26:26.378617 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81f986-cba1-4a4e-9c70-03829ffc0107 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:26.379153 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81f986-cba1-4a4e-9c70-03829ffc0107 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:26.379153 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81f986-cba1-4a4e-9c70-03829ffc0107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:26.419998 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-1a81f986-cba1-4a4e-9c70-03829ffc0107 None None] MFA Rules not processed for user `315a0525be7d48c1ab11ba23499e6ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:26:26.421377 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-1a81f986-cba1-4a4e-9c70-03829ffc0107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:26:26.428857 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 597/1183] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 24 17:26:26 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:26:26.433156 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecfa12-c0c7-462e-a156-c858dac6de2c None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:26.448123 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecfa12-c0c7-462e-a156-c858dac6de2c None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:26.453586 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbf992-3e3e-4704-bcd3-d297764056b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:26.454744 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbf992-3e3e-4704-bcd3-d297764056b7 admin admin] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:26.455017 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbf992-3e3e-4704-bcd3-d297764056b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:26.455350 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbf992-3e3e-4704-bcd3-d297764056b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:26.456576 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbf992-3e3e-4704-bcd3-d297764056b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:26.458234 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbf992-3e3e-4704-bcd3-d297764056b7 admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:26.497722 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 598/1184] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 24 17:26:26 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:26:26.501477 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbf992-3e3e-4704-bcd3-d297764056b7 admin admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:26.502407 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 587/1185] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 24 17:26:26 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:26:26.507191 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81f986-cba1-4a4e-9c70-03829ffc0107 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:26.519420 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81f986-cba1-4a4e-9c70-03829ffc0107 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:26.587699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:26:26.596754 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbf992-3e3e-4704-bcd3-d297764056b7 admin admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:26.600821 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14f649-522d-4aea-8f03-04012dbd6dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:26.601878 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14f649-522d-4aea-8f03-04012dbd6dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:26.602437 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14f649-522d-4aea-8f03-04012dbd6dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:26.602699 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2913f2-4075-45ae-ad13-1d7b1e394ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:26.603095 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14f649-522d-4aea-8f03-04012dbd6dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:26.603647 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2913f2-4075-45ae-ad13-1d7b1e394ead admin admin] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:26.603989 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2913f2-4075-45ae-ad13-1d7b1e394ead admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:26.604327 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2913f2-4075-45ae-ad13-1d7b1e394ead admin admin] PATH_INFO: `/v3/users` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:26.604644 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d14f649-522d-4aea-8f03-04012dbd6dd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:26.605146 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2913f2-4075-45ae-ad13-1d7b1e394ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:26.607406 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d14f649-522d-4aea-8f03-04012dbd6dd6 admin admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:26.610240 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2913f2-4075-45ae-ad13-1d7b1e394ead admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:26.643151 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 599/1186] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 24 17:26:26 2022] POST /identity/v3/users => generated 295 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 17:26:26.644160 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 588/1187] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 24 17:26:26 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:26:26.648006 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2913f2-4075-45ae-ad13-1d7b1e394ead admin admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:26.648244 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14f649-522d-4aea-8f03-04012dbd6dd6 admin admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:26.659663 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2913f2-4075-45ae-ad13-1d7b1e394ead admin admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:26.661008 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:26:26.734989 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14f649-522d-4aea-8f03-04012dbd6dd6 admin admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:26.743286 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e5a7a-2403-4f9b-b3d4-abb5356cab93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:26.743615 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d758e3-ec8d-4e26-8270-52069af990fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:26.744174 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e5a7a-2403-4f9b-b3d4-abb5356cab93 admin admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:26.744542 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e5a7a-2403-4f9b-b3d4-abb5356cab93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:26.744904 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e5a7a-2403-4f9b-b3d4-abb5356cab93 admin admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:26.745029 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d758e3-ec8d-4e26-8270-52069af990fa admin admin] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:26.745249 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d758e3-ec8d-4e26-8270-52069af990fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:26.745527 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d758e3-ec8d-4e26-8270-52069af990fa admin admin] PATH_INFO: `/v3/users` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:26.746120 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e5a7a-2403-4f9b-b3d4-abb5356cab93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:26.746237 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d758e3-ec8d-4e26-8270-52069af990fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:26.749036 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e5a7a-2403-4f9b-b3d4-abb5356cab93 admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:26.749210 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d758e3-ec8d-4e26-8270-52069af990fa admin admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:26.766168 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 600/1188] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 24 17:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 17:26:26.768329 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e5a7a-2403-4f9b-b3d4-abb5356cab93 admin admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:26.779048 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e5a7a-2403-4f9b-b3d4-abb5356cab93 admin admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:26.779382 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 589/1189] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 24 17:26:26 2022] POST /identity/v3/users => generated 298 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 17:26:26.783467 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d758e3-ec8d-4e26-8270-52069af990fa admin admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:26.783876 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a75c69-52f8-45bd-b66d-2e6177e89021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:26.784985 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a75c69-52f8-45bd-b66d-2e6177e89021 admin admin] REQUEST_METHOD: `PUT` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:26.785107 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a75c69-52f8-45bd-b66d-2e6177e89021 admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:26.785457 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a75c69-52f8-45bd-b66d-2e6177e89021 admin admin] PATH_INFO: `/v3/projects/3a40efe1f5c44570a28a71fb13e63171/users/2021931766174a22bfecce1fd19966fb/roles/ae295b7c396a4e559ecd6d574f097d4a` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:26.795010 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d758e3-ec8d-4e26-8270-52069af990fa admin admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:26.800535 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d995a-0566-46c2-afc4-69e7186cd829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:26.801255 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d995a-0566-46c2-afc4-69e7186cd829 admin admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:26.801554 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d995a-0566-46c2-afc4-69e7186cd829 admin admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:26.801824 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d995a-0566-46c2-afc4-69e7186cd829 admin admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:26.802608 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d995a-0566-46c2-afc4-69e7186cd829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:26.804639 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d995a-0566-46c2-afc4-69e7186cd829 admin admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:26.805447 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a75c69-52f8-45bd-b66d-2e6177e89021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a40efe1f5c44570a28a71fb13e63171, user_id=2021931766174a22bfecce1fd19966fb, role_id=ae295b7c396a4e559ecd6d574f097d4a)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:26.808510 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a75c69-52f8-45bd-b66d-2e6177e89021 admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:26.826246 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 590/1190] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 24 17:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 17:26:26.830450 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d995a-0566-46c2-afc4-69e7186cd829 admin admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:26.843786 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 601/1191] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 24 17:26:26 2022] PUT /identity/v3/projects/3a40efe1f5c44570a28a71fb13e63171/users/2021931766174a22bfecce1fd19966fb/roles/ae295b7c396a4e559ecd6d574f097d4a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:26:26.844034 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d995a-0566-46c2-afc4-69e7186cd829 admin admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:26.845517 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a75c69-52f8-45bd-b66d-2e6177e89021 admin admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:26.919062 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e629b0-9b0c-4b0c-980e-f05d71d27d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:26.920075 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e629b0-9b0c-4b0c-980e-f05d71d27d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:26.920445 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e629b0-9b0c-4b0c-980e-f05d71d27d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:26.920783 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e629b0-9b0c-4b0c-980e-f05d71d27d1d admin admin] PATH_INFO: `/v3/projects/bc13e99c11b14a2583b1b044199039fe/users/b587fa488e8c4ba5834cd16f01f7de36/roles/ae295b7c396a4e559ecd6d574f097d4a` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:26.926162 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a75c69-52f8-45bd-b66d-2e6177e89021 admin admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:26.931962 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9888029-5ade-4b45-aac1-eb13982fcfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:26.932735 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9888029-5ade-4b45-aac1-eb13982fcfe9 admin admin] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:26.933085 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9888029-5ade-4b45-aac1-eb13982fcfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:26.933424 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9888029-5ade-4b45-aac1-eb13982fcfe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:26.934815 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9888029-5ade-4b45-aac1-eb13982fcfe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:26.936657 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9888029-5ade-4b45-aac1-eb13982fcfe9 admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:26.941505 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e629b0-9b0c-4b0c-980e-f05d71d27d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc13e99c11b14a2583b1b044199039fe, user_id=b587fa488e8c4ba5834cd16f01f7de36, role_id=ae295b7c396a4e559ecd6d574f097d4a)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:26.945131 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e629b0-9b0c-4b0c-980e-f05d71d27d1d admin admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:26.952092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 602/1192] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 24 17:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 17:26:26.956617 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9888029-5ade-4b45-aac1-eb13982fcfe9 admin admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:26.970700 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 591/1193] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 24 17:26:26 2022] PUT /identity/v3/projects/bc13e99c11b14a2583b1b044199039fe/users/b587fa488e8c4ba5834cd16f01f7de36/roles/ae295b7c396a4e559ecd6d574f097d4a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 17:26:26.971051 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9888029-5ade-4b45-aac1-eb13982fcfe9 admin admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:26.973467 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e629b0-9b0c-4b0c-980e-f05d71d27d1d admin admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:27.030950 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:26:27.042435 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9780c6-fed9-42b1-971a-29e2f5dfb7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:27.043414 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9780c6-fed9-42b1-971a-29e2f5dfb7a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:27.043776 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9780c6-fed9-42b1-971a-29e2f5dfb7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:27.044524 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9780c6-fed9-42b1-971a-29e2f5dfb7a8 admin admin] PATH_INFO: `/v3/projects/3a40efe1f5c44570a28a71fb13e63171/users/2021931766174a22bfecce1fd19966fb/roles/ae295b7c396a4e559ecd6d574f097d4a` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:27.046141 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9780c6-fed9-42b1-971a-29e2f5dfb7a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a40efe1f5c44570a28a71fb13e63171, user_id=2021931766174a22bfecce1fd19966fb, role_id=ae295b7c396a4e559ecd6d574f097d4a)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:27.049221 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9780c6-fed9-42b1-971a-29e2f5dfb7a8 admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:27.053522 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e629b0-9b0c-4b0c-980e-f05d71d27d1d admin admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:27.062563 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d33ba1-fd19-42a3-872e-dc811fb6665e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:27.063277 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d33ba1-fd19-42a3-872e-dc811fb6665e admin admin] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:27.063552 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d33ba1-fd19-42a3-872e-dc811fb6665e admin admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:27.063818 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d33ba1-fd19-42a3-872e-dc811fb6665e admin admin] PATH_INFO: `/v3/roles` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:27.064997 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d33ba1-fd19-42a3-872e-dc811fb6665e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:27.067185 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d33ba1-fd19-42a3-872e-dc811fb6665e admin admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:27.068862 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 603/1194] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 24 17:26:26 2022] PUT /identity/v3/projects/3a40efe1f5c44570a28a71fb13e63171/users/2021931766174a22bfecce1fd19966fb/roles/ae295b7c396a4e559ecd6d574f097d4a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:26:27.101802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 592/1195] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 24 17:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 17:26:27.106095 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9780c6-fed9-42b1-971a-29e2f5dfb7a8 admin admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:27.201882 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9780c6-fed9-42b1-971a-29e2f5dfb7a8 admin admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:27.207677 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136d3c8-02df-4cd4-8989-3a13a3d3cc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:27.208681 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136d3c8-02df-4cd4-8989-3a13a3d3cc0a admin admin] REQUEST_METHOD: `PUT` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:27.208965 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136d3c8-02df-4cd4-8989-3a13a3d3cc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:27.209240 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136d3c8-02df-4cd4-8989-3a13a3d3cc0a admin admin] PATH_INFO: `/v3/projects/bc13e99c11b14a2583b1b044199039fe/users/b587fa488e8c4ba5834cd16f01f7de36/roles/ae295b7c396a4e559ecd6d574f097d4a` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:27.213084 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136d3c8-02df-4cd4-8989-3a13a3d3cc0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc13e99c11b14a2583b1b044199039fe, user_id=b587fa488e8c4ba5834cd16f01f7de36, role_id=ae295b7c396a4e559ecd6d574f097d4a)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:27.216886 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136d3c8-02df-4cd4-8989-3a13a3d3cc0a admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:27.240289 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 604/1196] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 24 17:26:27 2022] PUT /identity/v3/projects/bc13e99c11b14a2583b1b044199039fe/users/b587fa488e8c4ba5834cd16f01f7de36/roles/ae295b7c396a4e559ecd6d574f097d4a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:26:33.537978 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b952f9-16d4-46c5-9062-8452daeaf538 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:33.538477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b952f9-16d4-46c5-9062-8452daeaf538 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:33.538672 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b952f9-16d4-46c5-9062-8452daeaf538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:33.544612 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:26:33.573996 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-40b952f9-16d4-46c5-9062-8452daeaf538 None None] MFA Rules not processed for user `2021931766174a22bfecce1fd19966fb`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:26:33.575555 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-40b952f9-16d4-46c5-9062-8452daeaf538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:26:33.716790 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 593/1197] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 24 17:26:33 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:26:33.734199 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136d3c8-02df-4cd4-8989-3a13a3d3cc0a admin admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:33.736531 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-c136d3c8-02df-4cd4-8989-3a13a3d3cc0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:26:33.863470 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136d3c8-02df-4cd4-8989-3a13a3d3cc0a admin admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:33.868957 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0f0c4-db94-4007-b3ff-bc054dcd84ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb10c682def54ce9a22445a9b880d8ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:33.869926 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0f0c4-db94-4007-b3ff-bc054dcd84ee service glance] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:33.870696 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0f0c4-db94-4007-b3ff-bc054dcd84ee service glance] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:33.871173 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0f0c4-db94-4007-b3ff-bc054dcd84ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:33.968602 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0f0c4-db94-4007-b3ff-bc054dcd84ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:33.970435 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0f0c4-db94-4007-b3ff-bc054dcd84ee service glance] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:33.996278 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 605/1198] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:26:33 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:26:34.476046 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd0f30-a3ba-4a30-9548-c1f0ca0028ca None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:34.476575 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd0f30-a3ba-4a30-9548-c1f0ca0028ca None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:34.477162 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd0f30-a3ba-4a30-9548-c1f0ca0028ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:34.526084 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-90dd0f30-a3ba-4a30-9548-c1f0ca0028ca None None] MFA Rules not processed for user `b587fa488e8c4ba5834cd16f01f7de36`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:26:34.527360 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-90dd0f30-a3ba-4a30-9548-c1f0ca0028ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:26:34.634933 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 594/1199] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 24 17:26:34 2022] POST /identity/v3/auth/tokens => generated 2877 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:26:34.657291 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0f0c4-db94-4007-b3ff-bc054dcd84ee service glance] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:34.666613 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0f0c4-db94-4007-b3ff-bc054dcd84ee service glance] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:34.672867 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b835c-35a8-40e8-91c0-5ef24d54e285 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb10c682def54ce9a22445a9b880d8ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:34.673698 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b835c-35a8-40e8-91c0-5ef24d54e285 service glance] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:34.674631 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b835c-35a8-40e8-91c0-5ef24d54e285 service glance] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:34.674631 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b835c-35a8-40e8-91c0-5ef24d54e285 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:34.705364 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:26:34.752456 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b835c-35a8-40e8-91c0-5ef24d54e285 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:34.755061 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b835c-35a8-40e8-91c0-5ef24d54e285 service glance] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:34.766791 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 606/1200] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:26:34 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:26:43.497984 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffefabc-5989-452a-8161-2ece4b7a92f5 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:43.499284 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffefabc-5989-452a-8161-2ece4b7a92f5 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:43.500729 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffefabc-5989-452a-8161-2ece4b7a92f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:43.526913 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-3ffefabc-5989-452a-8161-2ece4b7a92f5 None None] MFA Rules not processed for user `315a0525be7d48c1ab11ba23499e6ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:26:43.528820 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-3ffefabc-5989-452a-8161-2ece4b7a92f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:26:43.540400 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 595/1201] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 24 17:26:43 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:26:43.873075 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e271ca-ce74-4c67-a961-d3113ac68714 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:43.873559 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e271ca-ce74-4c67-a961-d3113ac68714 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:43.873641 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e271ca-ce74-4c67-a961-d3113ac68714 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:43.875367 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 607/1202] 10.222.0.15 () {54 vars in 961 bytes} [Fri Jun 24 17:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:26:43.886895 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f57445-6140-4ae9-908e-84487008adc3 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:43.888124 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f57445-6140-4ae9-908e-84487008adc3 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:43.888982 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f57445-6140-4ae9-908e-84487008adc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:43.959161 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-90f57445-6140-4ae9-908e-84487008adc3 None None] MFA Rules not processed for user `9ff8200a750d49b1830c58f279e569c3`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:26:43.960253 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-90f57445-6140-4ae9-908e-84487008adc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:26:44.037085 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=100 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:26:44.062756 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 596/1203] 10.222.0.15 () {58 vars in 1058 bytes} [Fri Jun 24 17:26:43 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:26:44.065260 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e599ac9-44bc-45c5-83f5-1f026f6c43bc None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:44.065606 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e599ac9-44bc-45c5-83f5-1f026f6c43bc None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:44.065958 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e599ac9-44bc-45c5-83f5-1f026f6c43bc None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:44.067658 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 608/1204] 10.222.0.15 () {54 vars in 912 bytes} [Fri Jun 24 17:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:26:44.073648 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541d19e-033a-4190-b8b1-015c7263e090 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:44.073990 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541d19e-033a-4190-b8b1-015c7263e090 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:44.074277 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541d19e-033a-4190-b8b1-015c7263e090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:44.096889 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-b541d19e-033a-4190-b8b1-015c7263e090 None None] MFA Rules not processed for user `9ff8200a750d49b1830c58f279e569c3`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:26:44.098133 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-b541d19e-033a-4190-b8b1-015c7263e090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:26:44.108663 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 597/1205] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Jun 24 17:26:44 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:26:44.123303 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e599ac9-44bc-45c5-83f5-1f026f6c43bc None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:44.125274 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-7e599ac9-44bc-45c5-83f5-1f026f6c43bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:26:44.140836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e599ac9-44bc-45c5-83f5-1f026f6c43bc None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:44.146732 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e63a35-45a7-48f7-bdef-12e22efeabbb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb10c682def54ce9a22445a9b880d8ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:44.147800 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e63a35-45a7-48f7-bdef-12e22efeabbb service glance] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:44.148252 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e63a35-45a7-48f7-bdef-12e22efeabbb service glance] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:44.148698 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e63a35-45a7-48f7-bdef-12e22efeabbb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:44.163201 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e63a35-45a7-48f7-bdef-12e22efeabbb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:44.165062 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e63a35-45a7-48f7-bdef-12e22efeabbb service glance] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:44.178015 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 609/1206] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:26:44 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:26:44.594513 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dc44f-b748-4fac-9a2e-74bb8c787ed6 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:44.595237 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dc44f-b748-4fac-9a2e-74bb8c787ed6 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:44.595237 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dc44f-b748-4fac-9a2e-74bb8c787ed6 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:44.596578 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 598/1207] 10.222.0.15 () {54 vars in 912 bytes} [Fri Jun 24 17:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:26:44.601805 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363629d-b5ff-4529-915a-a4f2328287ef None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:44.602086 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363629d-b5ff-4529-915a-a4f2328287ef None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:44.602354 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363629d-b5ff-4529-915a-a4f2328287ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:44.622807 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-f363629d-b5ff-4529-915a-a4f2328287ef None None] MFA Rules not processed for user `f6385ebfadc74598b3b024408455842e`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:26:44.624120 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-f363629d-b5ff-4529-915a-a4f2328287ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:26:44.693926 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 610/1208] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Jun 24 17:26:44 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:26:44.706006 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8dc44f-b748-4fac-9a2e-74bb8c787ed6 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:44.719337 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8dc44f-b748-4fac-9a2e-74bb8c787ed6 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:44.722899 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6612e-4833-42e6-825d-95107f8305cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:44.723704 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6612e-4833-42e6-825d-95107f8305cb service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:44.723992 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6612e-4833-42e6-825d-95107f8305cb service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:44.724262 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6612e-4833-42e6-825d-95107f8305cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:44.734887 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6612e-4833-42e6-825d-95107f8305cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:44.736940 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6612e-4833-42e6-825d-95107f8305cb service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:44.747011 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 599/1209] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:26:44 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:26:45.198888 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118c388-bb4e-4298-8fb9-fc8f84f01241 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:45.199400 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118c388-bb4e-4298-8fb9-fc8f84f01241 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:45.199602 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118c388-bb4e-4298-8fb9-fc8f84f01241 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:45.201258 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 611/1210] 10.222.0.15 () {54 vars in 961 bytes} [Fri Jun 24 17:26:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:26:45.207341 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b94b85-df69-44ae-af87-ead8f0436ea2 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:45.207817 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b94b85-df69-44ae-af87-ead8f0436ea2 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:45.208151 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b94b85-df69-44ae-af87-ead8f0436ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:45.218129 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c610d-8b78-4ee0-ad96-0a5d239195eb None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:45.218690 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c610d-8b78-4ee0-ad96-0a5d239195eb None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:45.218971 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c610d-8b78-4ee0-ad96-0a5d239195eb None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:45.220586 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 612/1211] 10.222.0.15 () {54 vars in 960 bytes} [Fri Jun 24 17:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:26:45.226075 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c8adb-8b3f-41fc-8b8e-7f29d894f51b None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:45.226662 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c8adb-8b3f-41fc-8b8e-7f29d894f51b None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:45.227105 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c8adb-8b3f-41fc-8b8e-7f29d894f51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:45.235579 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-06b94b85-df69-44ae-af87-ead8f0436ea2 None None] MFA Rules not processed for user `9ff8200a750d49b1830c58f279e569c3`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:26:45.236830 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-06b94b85-df69-44ae-af87-ead8f0436ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:26:45.245714 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 600/1212] 10.222.0.15 () {58 vars in 1058 bytes} [Fri Jun 24 17:26:45 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:26:45.252199 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d68f6d-cb86-4083-b8df-733b9677b43b None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:45.252623 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d68f6d-cb86-4083-b8df-733b9677b43b None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:45.252935 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d68f6d-cb86-4083-b8df-733b9677b43b None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:45.255281 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 601/1213] 10.222.0.15 () {54 vars in 912 bytes} [Fri Jun 24 17:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 17:26:45.260437 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5241f50-6b01-4924-9edf-6837ccfb640c None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:45.260730 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5241f50-6b01-4924-9edf-6837ccfb640c None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:45.260990 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5241f50-6b01-4924-9edf-6837ccfb640c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:45.265456 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-085c8adb-8b3f-41fc-8b8e-7f29d894f51b None None] MFA Rules not processed for user `b318b7cfb1c5485cba96997ddd73945c`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:26:45.266802 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-085c8adb-8b3f-41fc-8b8e-7f29d894f51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:26:45.284923 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-c5241f50-6b01-4924-9edf-6837ccfb640c None None] MFA Rules not processed for user `9ff8200a750d49b1830c58f279e569c3`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:26:45.286332 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-c5241f50-6b01-4924-9edf-6837ccfb640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:26:45.296868 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 602/1214] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Jun 24 17:26:45 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:26:45.309765 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5241f50-6b01-4924-9edf-6837ccfb640c None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:45.319704 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5241f50-6b01-4924-9edf-6837ccfb640c None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:45.324376 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15093228-ad08-4b02-813f-3bf6363b540d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:45.326058 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15093228-ad08-4b02-813f-3bf6363b540d service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:45.326339 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15093228-ad08-4b02-813f-3bf6363b540d service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:45.326659 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15093228-ad08-4b02-813f-3bf6363b540d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:45.338927 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15093228-ad08-4b02-813f-3bf6363b540d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:45.341733 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15093228-ad08-4b02-813f-3bf6363b540d service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:45.347157 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 613/1215] 10.222.0.15 () {58 vars in 1057 bytes} [Fri Jun 24 17:26:45 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 17:26:45.355101 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c8adb-8b3f-41fc-8b8e-7f29d894f51b None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:45.361538 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 603/1216] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:26:45 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 17:26:45.368788 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c8adb-8b3f-41fc-8b8e-7f29d894f51b None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:45.375652 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a092b02-cc36-4482-956c-978a9c3a6e37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b318b7cfb1c5485cba96997ddd73945c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:45.376321 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a092b02-cc36-4482-956c-978a9c3a6e37 service placement] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:45.376596 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a092b02-cc36-4482-956c-978a9c3a6e37 service placement] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:45.376865 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a092b02-cc36-4482-956c-978a9c3a6e37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:45.378861 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-0a092b02-cc36-4482-956c-978a9c3a6e37 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:26:45.391774 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a092b02-cc36-4482-956c-978a9c3a6e37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:45.393379 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a092b02-cc36-4482-956c-978a9c3a6e37 service placement] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:45.404349 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 614/1217] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:26:45 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:26:55.355337 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=25 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:26:55.399451 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=85 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:26:57.351925 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c28f92-18cd-4995-9d04-06c659d6d1a5 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:57.352483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c28f92-18cd-4995-9d04-06c659d6d1a5 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:57.352483 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c28f92-18cd-4995-9d04-06c659d6d1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:57.373635 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-e8c28f92-18cd-4995-9d04-06c659d6d1a5 None None] MFA Rules not processed for user `f6385ebfadc74598b3b024408455842e`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:26:57.375375 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-e8c28f92-18cd-4995-9d04-06c659d6d1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:26:57.384411 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 604/1218] 10.222.0.59 () {58 vars in 1015 bytes} [Fri Jun 24 17:26:57 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:26:57.398132 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a092b02-cc36-4482-956c-978a9c3a6e37 service placement] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:57.409327 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a092b02-cc36-4482-956c-978a9c3a6e37 service placement] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:57.413331 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47f713-d4dc-4f0a-bff8-bb0b6215c0d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:57.414049 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47f713-d4dc-4f0a-bff8-bb0b6215c0d8 service neutron] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:57.414398 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47f713-d4dc-4f0a-bff8-bb0b6215c0d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:57.414782 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47f713-d4dc-4f0a-bff8-bb0b6215c0d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:57.424189 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47f713-d4dc-4f0a-bff8-bb0b6215c0d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:57.425631 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47f713-d4dc-4f0a-bff8-bb0b6215c0d8 service neutron] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:57.435633 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 615/1219] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:26:57 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:26:58.246506 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8270f-07c9-4d47-a9c1-ee83cf6471df None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:58.246878 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8270f-07c9-4d47-a9c1-ee83cf6471df None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:58.247142 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8270f-07c9-4d47-a9c1-ee83cf6471df None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:58.249557 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 605/1220] 10.222.0.15 () {54 vars in 921 bytes} [Fri Jun 24 17:26:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:26:58.272597 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e85a58-9e7a-40b3-8e7b-ceaa412dd742 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:58.273247 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e85a58-9e7a-40b3-8e7b-ceaa412dd742 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:58.273755 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e85a58-9e7a-40b3-8e7b-ceaa412dd742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:58.313407 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-98e85a58-9e7a-40b3-8e7b-ceaa412dd742 None None] MFA Rules not processed for user `9ff8200a750d49b1830c58f279e569c3`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:26:58.317143 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-98e85a58-9e7a-40b3-8e7b-ceaa412dd742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:26:58.328095 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 616/1221] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Jun 24 17:26:58 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 17:26:58.386672 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8270f-07c9-4d47-a9c1-ee83cf6471df None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:26:58.401985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8270f-07c9-4d47-a9c1-ee83cf6471df None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:26:58.408548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d3f23-2265-46be-af76-c892eb20c61b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:26:58.409358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d3f23-2265-46be-af76-c892eb20c61b service nova] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:26:58.409685 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d3f23-2265-46be-af76-c892eb20c61b service nova] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:26:58.410122 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d3f23-2265-46be-af76-c892eb20c61b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:26:58.420157 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d3f23-2265-46be-af76-c892eb20c61b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:26:58.421820 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d3f23-2265-46be-af76-c892eb20c61b service nova] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:26:58.436684 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 606/1222] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:26:58 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:27:05.261269 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f910bb-93dc-48b0-b0b8-fd4978cc14fe None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:27:05.261955 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f910bb-93dc-48b0-b0b8-fd4978cc14fe None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:27:05.261955 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f910bb-93dc-48b0-b0b8-fd4978cc14fe None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:27:05.263569 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 617/1223] 10.222.0.15 () {54 vars in 921 bytes} [Fri Jun 24 17:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:27:05.272296 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485e7e8-0508-48b1-b2ef-587521987bea None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:27:05.272882 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485e7e8-0508-48b1-b2ef-587521987bea None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:27:05.272882 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485e7e8-0508-48b1-b2ef-587521987bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:27:05.295638 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-d485e7e8-0508-48b1-b2ef-587521987bea None None] MFA Rules not processed for user `9ff8200a750d49b1830c58f279e569c3`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:27:05.296851 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-d485e7e8-0508-48b1-b2ef-587521987bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:27:05.306371 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 607/1224] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Jun 24 17:27:05 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:27:05.321178 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f910bb-93dc-48b0-b0b8-fd4978cc14fe None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:27:05.341133 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f910bb-93dc-48b0-b0b8-fd4978cc14fe None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:27:05.348836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c573b0-6b14-49f5-b6c6-7afd73de83a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:27:05.349582 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c573b0-6b14-49f5-b6c6-7afd73de83a6 service nova] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:27:05.349918 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c573b0-6b14-49f5-b6c6-7afd73de83a6 service nova] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:27:05.350254 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c573b0-6b14-49f5-b6c6-7afd73de83a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:27:05.360336 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c573b0-6b14-49f5-b6c6-7afd73de83a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:27:05.361934 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c573b0-6b14-49f5-b6c6-7afd73de83a6 service nova] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:27:05.372533 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 618/1225] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:27:05 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:27:15.289373 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=12 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:27:15.368141 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=15 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:27:19.383442 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485e7e8-0508-48b1-b2ef-587521987bea None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:27:19.394021 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485e7e8-0508-48b1-b2ef-587521987bea None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:27:19.398512 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420be585-3c1a-4c6e-9b38-f4acc32b72e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:27:19.404607 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420be585-3c1a-4c6e-9b38-f4acc32b72e1 service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:27:19.404607 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420be585-3c1a-4c6e-9b38-f4acc32b72e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:27:19.404607 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420be585-3c1a-4c6e-9b38-f4acc32b72e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:27:19.412173 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420be585-3c1a-4c6e-9b38-f4acc32b72e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:27:19.413704 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420be585-3c1a-4c6e-9b38-f4acc32b72e1 service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:27:19.424048 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 608/1226] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:27:19 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:27:29.419033 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=6 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:27:38.142767 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde615b-7adf-4938-b096-5fcae01d53e3 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:27:38.143428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde615b-7adf-4938-b096-5fcae01d53e3 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:27:38.143428 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde615b-7adf-4938-b096-5fcae01d53e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:27:38.162176 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-dbde615b-7adf-4938-b096-5fcae01d53e3 None None] MFA Rules not processed for user `66beb08e5cb24d57aa4b41137cf3d649`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:27:38.163426 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-dbde615b-7adf-4938-b096-5fcae01d53e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:27:38.171415 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 619/1227] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 24 17:27:38 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:27:48.157344 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=3 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:28:05.068004 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bbdfc-7d77-4225-bcea-4bf87b137bfc None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:28:05.068532 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bbdfc-7d77-4225-bcea-4bf87b137bfc None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:28:05.068532 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bbdfc-7d77-4225-bcea-4bf87b137bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:28:05.086253 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-0b5bbdfc-7d77-4225-bcea-4bf87b137bfc None None] MFA Rules not processed for user `66beb08e5cb24d57aa4b41137cf3d649`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:28:05.087223 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-0b5bbdfc-7d77-4225-bcea-4bf87b137bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:28:05.094598 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 609/1228] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 24 17:28:05 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 17:28:05.378256 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251848e7-b5e9-4efc-8e15-6d07e5390939 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:28:05.378890 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251848e7-b5e9-4efc-8e15-6d07e5390939 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:28:05.378890 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251848e7-b5e9-4efc-8e15-6d07e5390939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:28:05.428684 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-251848e7-b5e9-4efc-8e15-6d07e5390939 None None] MFA Rules not processed for user `f6385ebfadc74598b3b024408455842e`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:28:05.429888 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-251848e7-b5e9-4efc-8e15-6d07e5390939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:28:05.446553 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 620/1229] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Jun 24 17:28:05 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:28:05.458358 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bbdfc-7d77-4225-bcea-4bf87b137bfc None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:28:05.469188 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bbdfc-7d77-4225-bcea-4bf87b137bfc None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:28:05.474757 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b5f14-8fc8-4f65-b532-d748498ad96d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:28:05.475452 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b5f14-8fc8-4f65-b532-d748498ad96d service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:28:05.475774 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b5f14-8fc8-4f65-b532-d748498ad96d service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:28:05.476042 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b5f14-8fc8-4f65-b532-d748498ad96d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:28:05.493427 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b5f14-8fc8-4f65-b532-d748498ad96d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:28:05.494911 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b5f14-8fc8-4f65-b532-d748498ad96d service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:28:05.504343 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 610/1230] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:28:05 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:28:15.443460 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=17 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:28:15.502970 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=9 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:28:20.117347 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d52f1-9a4b-464e-ae95-d6d3ca3e6989 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:28:20.117913 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d52f1-9a4b-464e-ae95-d6d3ca3e6989 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:28:20.118068 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d52f1-9a4b-464e-ae95-d6d3ca3e6989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:28:20.137698 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-7c9d52f1-9a4b-464e-ae95-d6d3ca3e6989 None None] MFA Rules not processed for user `66beb08e5cb24d57aa4b41137cf3d649`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:28:20.138978 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-7c9d52f1-9a4b-464e-ae95-d6d3ca3e6989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:28:20.147307 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 621/1231] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 24 17:28:20 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:28:30.132415 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=3 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:29:19.592318 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9076516-75a1-45e0-9248-33f1548cfc54 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:29:19.592911 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9076516-75a1-45e0-9248-33f1548cfc54 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:29:19.592911 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9076516-75a1-45e0-9248-33f1548cfc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:29:19.613107 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-d9076516-75a1-45e0-9248-33f1548cfc54 None None] MFA Rules not processed for user `66beb08e5cb24d57aa4b41137cf3d649`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:29:19.614326 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-d9076516-75a1-45e0-9248-33f1548cfc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:29:19.622529 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 611/1232] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 24 17:29:19 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:29:29.607695 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=3 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:29:32.612066 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d52f1-9a4b-464e-ae95-d6d3ca3e6989 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:29:32.628914 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d52f1-9a4b-464e-ae95-d6d3ca3e6989 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:29:32.633429 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836a38f-df39-4cc5-a381-3e5bb5521f26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:29:32.634084 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836a38f-df39-4cc5-a381-3e5bb5521f26 service neutron] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:29:32.634359 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836a38f-df39-4cc5-a381-3e5bb5521f26 service neutron] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:29:32.634660 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836a38f-df39-4cc5-a381-3e5bb5521f26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:29:32.645585 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836a38f-df39-4cc5-a381-3e5bb5521f26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:29:32.646901 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836a38f-df39-4cc5-a381-3e5bb5521f26 service neutron] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:29:32.657376 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 622/1233] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:29:32 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:29:33.174532 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9076516-75a1-45e0-9248-33f1548cfc54 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:29:33.206553 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9076516-75a1-45e0-9248-33f1548cfc54 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:29:33.212967 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a53bea-75da-403e-808f-67c1e98f94b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b318b7cfb1c5485cba96997ddd73945c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:29:33.213636 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a53bea-75da-403e-808f-67c1e98f94b5 service placement] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:29:33.213917 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a53bea-75da-403e-808f-67c1e98f94b5 service placement] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:29:33.214265 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a53bea-75da-403e-808f-67c1e98f94b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:29:33.225579 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a53bea-75da-403e-808f-67c1e98f94b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:29:33.227259 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a53bea-75da-403e-808f-67c1e98f94b5 service placement] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:29:33.237982 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 612/1234] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:29:33 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:29:34.712346 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37c776-a65b-4d45-a827-8dcb384b2771 None None] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:29:34.712887 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37c776-a65b-4d45-a827-8dcb384b2771 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:29:34.712887 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37c776-a65b-4d45-a827-8dcb384b2771 None None] PATH_INFO: `/` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:29:34.714664 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 623/1235] 10.222.0.15 () {54 vars in 921 bytes} [Fri Jun 24 17:29:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:29:34.720932 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044aefcd-f8ef-4154-aa35-9446090e3974 None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:29:34.721421 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044aefcd-f8ef-4154-aa35-9446090e3974 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:29:34.721497 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044aefcd-f8ef-4154-aa35-9446090e3974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:29:34.764001 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-044aefcd-f8ef-4154-aa35-9446090e3974 None None] MFA Rules not processed for user `9ff8200a750d49b1830c58f279e569c3`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:29:34.765359 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-044aefcd-f8ef-4154-aa35-9446090e3974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:29:34.784349 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 613/1236] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Jun 24 17:29:34 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:29:34.797836 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37c776-a65b-4d45-a827-8dcb384b2771 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:29:34.816316 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37c776-a65b-4d45-a827-8dcb384b2771 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:29:34.821862 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c7397-a403-47a8-acdd-a2642ab42db1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:29:34.822499 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c7397-a403-47a8-acdd-a2642ab42db1 service nova] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:29:34.822807 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c7397-a403-47a8-acdd-a2642ab42db1 service nova] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:29:34.823085 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c7397-a403-47a8-acdd-a2642ab42db1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:29:34.831858 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c7397-a403-47a8-acdd-a2642ab42db1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:29:34.833864 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c7397-a403-47a8-acdd-a2642ab42db1 service nova] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:29:34.844952 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 624/1237] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:29:34 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:29:44.780789 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=23 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:29:44.840522 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=12 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:31:40.614926 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044aefcd-f8ef-4154-aa35-9446090e3974 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:31:40.627272 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044aefcd-f8ef-4154-aa35-9446090e3974 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:31:40.633116 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87604490-6701-4c2b-9c2c-b27e6a3012ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:31:40.633757 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87604490-6701-4c2b-9c2c-b27e6a3012ea service nova] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:31:40.634034 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87604490-6701-4c2b-9c2c-b27e6a3012ea service nova] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:31:40.634379 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87604490-6701-4c2b-9c2c-b27e6a3012ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:31:40.643118 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87604490-6701-4c2b-9c2c-b27e6a3012ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:31:40.644729 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87604490-6701-4c2b-9c2c-b27e6a3012ea service nova] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:31:40.653826 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 614/1238] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:31:40 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:31:45.596167 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2066a35-147f-489c-8664-919f9d4cd0c5 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:31:45.596666 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2066a35-147f-489c-8664-919f9d4cd0c5 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:31:45.596666 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2066a35-147f-489c-8664-919f9d4cd0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:31:45.616091 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-b2066a35-147f-489c-8664-919f9d4cd0c5 None None] MFA Rules not processed for user `66beb08e5cb24d57aa4b41137cf3d649`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:31:45.617305 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-b2066a35-147f-489c-8664-919f9d4cd0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:31:45.625284 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 625/1239] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 24 17:31:45 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:31:45.671421 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87604490-6701-4c2b-9c2c-b27e6a3012ea service nova] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:31:45.750962 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87604490-6701-4c2b-9c2c-b27e6a3012ea service nova] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:31:45.755413 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a862653-2062-4900-94bf-95ee379165e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa7e8d98fb4744b7af95aa93050318d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:31:45.756048 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a862653-2062-4900-94bf-95ee379165e9 service cinder] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:31:45.756339 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a862653-2062-4900-94bf-95ee379165e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:31:45.756611 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a862653-2062-4900-94bf-95ee379165e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:31:45.766682 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a862653-2062-4900-94bf-95ee379165e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:31:45.768064 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a862653-2062-4900-94bf-95ee379165e9 service cinder] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:31:45.778132 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 615/1240] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:31:45 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:31:46.575138 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2066a35-147f-489c-8664-919f9d4cd0c5 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:31:46.580515 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a862653-2062-4900-94bf-95ee379165e9 service cinder] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:31:46.587879 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2066a35-147f-489c-8664-919f9d4cd0c5 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:31:46.590059 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a862653-2062-4900-94bf-95ee379165e9 service cinder] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:31:46.593794 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27debbdb-a482-404b-9b78-168264919062 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b318b7cfb1c5485cba96997ddd73945c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:31:46.593951 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5292a1-f9bb-435c-b683-6ee7b01f00ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:31:46.594427 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5292a1-f9bb-435c-b683-6ee7b01f00ab service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:31:46.594548 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27debbdb-a482-404b-9b78-168264919062 service placement] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:31:46.594742 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27debbdb-a482-404b-9b78-168264919062 service placement] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:31:46.594847 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5292a1-f9bb-435c-b683-6ee7b01f00ab service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:31:46.595009 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27debbdb-a482-404b-9b78-168264919062 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:31:46.595096 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5292a1-f9bb-435c-b683-6ee7b01f00ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:31:46.604161 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27debbdb-a482-404b-9b78-168264919062 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:31:46.604719 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5292a1-f9bb-435c-b683-6ee7b01f00ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:31:46.605756 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27debbdb-a482-404b-9b78-168264919062 service placement] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:31:46.606132 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5292a1-f9bb-435c-b683-6ee7b01f00ab service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:31:46.615968 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 626/1241] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:31:46 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:31:46.616894 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 616/1242] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:31:46 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:31:55.634593 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27debbdb-a482-404b-9b78-168264919062 service placement] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:31:55.647417 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27debbdb-a482-404b-9b78-168264919062 service placement] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:31:55.652890 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50108e1b-f816-48ca-9d16-68bbf016a708 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:31:55.653536 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50108e1b-f816-48ca-9d16-68bbf016a708 service nova] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:31:55.653814 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50108e1b-f816-48ca-9d16-68bbf016a708 service nova] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:31:55.654083 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50108e1b-f816-48ca-9d16-68bbf016a708 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:31:55.662646 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50108e1b-f816-48ca-9d16-68bbf016a708 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:31:55.664245 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50108e1b-f816-48ca-9d16-68bbf016a708 service nova] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:31:55.674322 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 627/1243] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:31:55 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:31:56.612047 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=42 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:31:57.527528 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5292a1-f9bb-435c-b683-6ee7b01f00ab service neutron] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:31:57.536464 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5292a1-f9bb-435c-b683-6ee7b01f00ab service neutron] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:31:57.541599 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bae38d-7857-4de7-9d23-e0a147645f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:31:57.542271 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bae38d-7857-4de7-9d23-e0a147645f1e service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:31:57.542548 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bae38d-7857-4de7-9d23-e0a147645f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:31:57.542832 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bae38d-7857-4de7-9d23-e0a147645f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:31:57.551724 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bae38d-7857-4de7-9d23-e0a147645f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:31:57.553176 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bae38d-7857-4de7-9d23-e0a147645f1e service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:31:57.562334 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 617/1244] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:31:57 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:31:58.343119 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50108e1b-f816-48ca-9d16-68bbf016a708 service nova] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:31:58.354461 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50108e1b-f816-48ca-9d16-68bbf016a708 service nova] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:31:58.360580 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803b657-3ca1-4e1a-b5fc-dee0d19adcac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:31:58.361774 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803b657-3ca1-4e1a-b5fc-dee0d19adcac service nova] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:31:58.362518 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803b657-3ca1-4e1a-b5fc-dee0d19adcac service nova] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:31:58.363077 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803b657-3ca1-4e1a-b5fc-dee0d19adcac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:31:58.373967 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803b657-3ca1-4e1a-b5fc-dee0d19adcac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:31:58.377935 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803b657-3ca1-4e1a-b5fc-dee0d19adcac service nova] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:31:58.389747 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 628/1245] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:31:58 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:32:07.558489 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=6 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:32:08.385057 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=21 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:32:11.957281 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8038692-3b28-432b-a3ee-55840e3f4bfc None None] REQUEST_METHOD: `POST` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:32:11.957849 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8038692-3b28-432b-a3ee-55840e3f4bfc None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:32:11.957849 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8038692-3b28-432b-a3ee-55840e3f4bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:32:11.978114 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.auth.core [None req-d8038692-3b28-432b-a3ee-55840e3f4bfc None None] MFA Rules not processed for user `315a0525be7d48c1ab11ba23499e6ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=87095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:32:11.979331 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-d8038692-3b28-432b-a3ee-55840e3f4bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:32:11.986802 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 618/1246] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 24 17:32:11 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:32:21.972556 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=3 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:32:31.039523 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803b657-3ca1-4e1a-b5fc-dee0d19adcac service nova] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:32:31.051383 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803b657-3ca1-4e1a-b5fc-dee0d19adcac service nova] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:32:31.057702 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29e5e0-e338-417a-a8a8-022d4e75dc1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:32:31.058352 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29e5e0-e338-417a-a8a8-022d4e75dc1d service nova] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:32:31.058739 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29e5e0-e338-417a-a8a8-022d4e75dc1d service nova] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:32:31.059001 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29e5e0-e338-417a-a8a8-022d4e75dc1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:32:31.068732 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29e5e0-e338-417a-a8a8-022d4e75dc1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:32:31.070360 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29e5e0-e338-417a-a8a8-022d4e75dc1d service nova] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:32:31.080462 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 629/1247] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:32:31 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:32:39.007984 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8038692-3b28-432b-a3ee-55840e3f4bfc None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:32:39.018694 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8038692-3b28-432b-a3ee-55840e3f4bfc None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:32:39.023120 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869c9aa-2e5e-4d25-bb53-00bd687ae694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:32:39.023780 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869c9aa-2e5e-4d25-bb53-00bd687ae694 service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:32:39.024059 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869c9aa-2e5e-4d25-bb53-00bd687ae694 service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:32:39.024329 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869c9aa-2e5e-4d25-bb53-00bd687ae694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:32:39.035348 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869c9aa-2e5e-4d25-bb53-00bd687ae694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:32:39.036841 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869c9aa-2e5e-4d25-bb53-00bd687ae694 service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:32:39.047525 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 619/1248] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:32:39 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:32:41.076347 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=6 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:32:49.042304 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=6 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:33:56.188436 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abb5ca-d3ff-4ee5-9f4e-80cbc8e08a32 None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:33:56.189067 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abb5ca-d3ff-4ee5-9f4e-80cbc8e08a32 None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:33:56.189067 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abb5ca-d3ff-4ee5-9f4e-80cbc8e08a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:33:56.211635 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-79abb5ca-d3ff-4ee5-9f4e-80cbc8e08a32 None None] MFA Rules not processed for user `66beb08e5cb24d57aa4b41137cf3d649`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:33:56.212825 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-79abb5ca-d3ff-4ee5-9f4e-80cbc8e08a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:33:56.219929 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 630/1249] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 24 17:33:56 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:33:56.545265 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869c9aa-2e5e-4d25-bb53-00bd687ae694 service neutron] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:33:56.556472 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869c9aa-2e5e-4d25-bb53-00bd687ae694 service neutron] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:33:56.560420 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdf263-002f-45e8-8e7a-5704b1ef32ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:33:56.561543 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdf263-002f-45e8-8e7a-5704b1ef32ed service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:33:56.561543 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdf263-002f-45e8-8e7a-5704b1ef32ed service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:33:56.561543 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdf263-002f-45e8-8e7a-5704b1ef32ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:33:56.570381 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdf263-002f-45e8-8e7a-5704b1ef32ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:33:56.571595 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdf263-002f-45e8-8e7a-5704b1ef32ed service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:33:56.579948 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 620/1250] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:33:56 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:34:06.207147 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=3 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:34:06.576874 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=6 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:34:36.895841 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abb5ca-d3ff-4ee5-9f4e-80cbc8e08a32 None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:34:36.943208 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abb5ca-d3ff-4ee5-9f4e-80cbc8e08a32 None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:34:36.950800 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140c7e5-f255-459e-bb3e-63abe3edcd25 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b318b7cfb1c5485cba96997ddd73945c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:34:36.951444 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140c7e5-f255-459e-bb3e-63abe3edcd25 service placement] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:34:36.951846 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140c7e5-f255-459e-bb3e-63abe3edcd25 service placement] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:34:36.952256 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140c7e5-f255-459e-bb3e-63abe3edcd25 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:34:36.954767 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-2140c7e5-f255-459e-bb3e-63abe3edcd25 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:34:36.991772 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140c7e5-f255-459e-bb3e-63abe3edcd25 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:34:36.993432 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140c7e5-f255-459e-bb3e-63abe3edcd25 service placement] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:34:37.004522 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 631/1251] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:34:36 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 17:34:46.999546 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=28 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:35:11.827784 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdf263-002f-45e8-8e7a-5704b1ef32ed service neutron] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:35:11.861317 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdf263-002f-45e8-8e7a-5704b1ef32ed service neutron] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:35:11.868361 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c37437-ce6f-4af8-a93c-ff2334aca0c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:35:11.869610 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c37437-ce6f-4af8-a93c-ff2334aca0c4 service nova] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:35:11.870247 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c37437-ce6f-4af8-a93c-ff2334aca0c4 service nova] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:35:11.870717 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c37437-ce6f-4af8-a93c-ff2334aca0c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:35:11.884571 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c37437-ce6f-4af8-a93c-ff2334aca0c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:35:11.886491 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c37437-ce6f-4af8-a93c-ff2334aca0c4 service nova] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:35:11.900853 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 621/1252] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:35:11 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:35:18.669532 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140c7e5-f255-459e-bb3e-63abe3edcd25 service placement] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:35:18.671204 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-2140c7e5-f255-459e-bb3e-63abe3edcd25 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:35:18.698047 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140c7e5-f255-459e-bb3e-63abe3edcd25 service placement] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:35:18.702124 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55b9fa-2e3a-49e6-bfc7-d99356a5ffa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:35:18.702812 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55b9fa-2e3a-49e6-bfc7-d99356a5ffa3 service neutron] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:35:18.703092 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55b9fa-2e3a-49e6-bfc7-d99356a5ffa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:35:18.703367 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55b9fa-2e3a-49e6-bfc7-d99356a5ffa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:35:18.777365 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55b9fa-2e3a-49e6-bfc7-d99356a5ffa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:35:18.778863 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55b9fa-2e3a-49e6-bfc7-d99356a5ffa3 service neutron] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:35:18.800520 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 632/1253] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:35:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:35:21.895015 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=11 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:35:22.369039 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc688cc7-fe60-4981-bcf7-2196006dbd52 None None] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:35:22.369575 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc688cc7-fe60-4981-bcf7-2196006dbd52 None None] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:35:22.370039 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc688cc7-fe60-4981-bcf7-2196006dbd52 None None] PATH_INFO: `/` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:35:22.371565 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 622/1254] 10.222.0.15 () {54 vars in 921 bytes} [Fri Jun 24 17:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 17:35:22.380562 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf517a68-67e1-428c-a387-5c84aa580afe None None] REQUEST_METHOD: `POST` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:35:22.381198 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf517a68-67e1-428c-a387-5c84aa580afe None None] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:35:22.381359 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf517a68-67e1-428c-a387-5c84aa580afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:35:22.440115 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.auth.core [None req-cf517a68-67e1-428c-a387-5c84aa580afe None None] MFA Rules not processed for user `b318b7cfb1c5485cba96997ddd73945c`. Rule list: `[]` (Enabled: `True`). {{(pid=87096) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 17:35:22.442046 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-cf517a68-67e1-428c-a387-5c84aa580afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:35:22.460642 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 633/1255] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Jun 24 17:35:22 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 17:35:22.473952 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc688cc7-fe60-4981-bcf7-2196006dbd52 None None] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:35:22.488753 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc688cc7-fe60-4981-bcf7-2196006dbd52 None None] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:35:22.493808 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad86c9-20ad-4792-a761-548d1eabbc56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b318b7cfb1c5485cba96997ddd73945c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:35:22.494735 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad86c9-20ad-4792-a761-548d1eabbc56 service placement] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:35:22.495219 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad86c9-20ad-4792-a761-548d1eabbc56 service placement] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:35:22.495647 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad86c9-20ad-4792-a761-548d1eabbc56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:35:22.506406 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad86c9-20ad-4792-a761-548d1eabbc56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:35:22.508396 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad86c9-20ad-4792-a761-548d1eabbc56 service placement] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:35:22.519703 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 623/1256] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:35:22 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:35:25.784067 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf517a68-67e1-428c-a387-5c84aa580afe None None] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:35:25.800101 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf517a68-67e1-428c-a387-5c84aa580afe None None] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:35:25.806745 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a6273-6501-4945-b88b-4c20519e1164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:35:25.807598 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a6273-6501-4945-b88b-4c20519e1164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:35:25.807864 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a6273-6501-4945-b88b-4c20519e1164 admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:35:25.808165 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a6273-6501-4945-b88b-4c20519e1164 admin admin] PATH_INFO: `/v3/users/315a0525be7d48c1ab11ba23499e6ce3` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:35:25.810441 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a6273-6501-4945-b88b-4c20519e1164 admin admin] RBAC: Authorizing `identity:delete_user(user_id=315a0525be7d48c1ab11ba23499e6ce3)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:35:25.811700 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: WARNING py.warnings [None req-d89a6273-6501-4945-b88b-4c20519e1164 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 17:35:25.811700 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: warnings.warn(msg) Jun 24 17:35:25.811700 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: Jun 24 17:35:25.812901 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a6273-6501-4945-b88b-4c20519e1164 admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:35:25.904529 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-d89a6273-6501-4945-b88b-4c20519e1164 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '315a0525be7d48c1ab11ba23499e6ce3'} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:35:25.933718 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-d89a6273-6501-4945-b88b-4c20519e1164 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '315a0525be7d48c1ab11ba23499e6ce3'} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:35:25.934481 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-d89a6273-6501-4945-b88b-4c20519e1164 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '315a0525be7d48c1ab11ba23499e6ce3'} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:35:25.944291 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-d89a6273-6501-4945-b88b-4c20519e1164 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '315a0525be7d48c1ab11ba23499e6ce3'} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:35:25.945182 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-d89a6273-6501-4945-b88b-4c20519e1164 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '315a0525be7d48c1ab11ba23499e6ce3'} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:35:25.963215 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 634/1257] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 24 17:35:25 2022] DELETE /identity/v3/users/315a0525be7d48c1ab11ba23499e6ce3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:35:26.172997 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad86c9-20ad-4792-a761-548d1eabbc56 service placement] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:35:26.185551 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad86c9-20ad-4792-a761-548d1eabbc56 service placement] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:35:26.271382 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ec9c0-8077-4782-ad12-466b9ad6de2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:35:26.272293 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ec9c0-8077-4782-ad12-466b9ad6de2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:35:26.272564 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ec9c0-8077-4782-ad12-466b9ad6de2a admin admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:35:26.272873 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ec9c0-8077-4782-ad12-466b9ad6de2a admin admin] PATH_INFO: `/v3/projects/d4345a67dda74a15a91474518cb7935f` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:35:26.274104 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ec9c0-8077-4782-ad12-466b9ad6de2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4345a67dda74a15a91474518cb7935f)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:35:26.275139 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: WARNING py.warnings [None req-207ec9c0-8077-4782-ad12-466b9ad6de2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 17:35:26.275139 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: warnings.warn(msg) Jun 24 17:35:26.275139 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: Jun 24 17:35:26.276341 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ec9c0-8077-4782-ad12-466b9ad6de2a admin admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:35:26.354907 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-207ec9c0-8077-4782-ad12-466b9ad6de2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4345a67dda74a15a91474518cb7935f', 'request_id': 'req-207ec9c0-8077-4782-ad12-466b9ad6de2a'} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:35:26.362542 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-207ec9c0-8077-4782-ad12-466b9ad6de2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4345a67dda74a15a91474518cb7935f', 'request_id': 'req-207ec9c0-8077-4782-ad12-466b9ad6de2a'} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:35:26.372569 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-207ec9c0-8077-4782-ad12-466b9ad6de2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4345a67dda74a15a91474518cb7935f', 'request_id': 'req-207ec9c0-8077-4782-ad12-466b9ad6de2a'} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:35:26.408165 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-207ec9c0-8077-4782-ad12-466b9ad6de2a admin admin] The token cache is being invalidate because project d4345a67dda74a15a91474518cb7935f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 17:35:26.408478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-207ec9c0-8077-4782-ad12-466b9ad6de2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:35:26.409117 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-207ec9c0-8077-4782-ad12-466b9ad6de2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:35:26.410980 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 624/1258] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 24 17:35:26 2022] DELETE /identity/v3/projects/d4345a67dda74a15a91474518cb7935f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:35:26.415713 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a6273-6501-4945-b88b-4c20519e1164 admin admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:35:26.417626 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-d89a6273-6501-4945-b88b-4c20519e1164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:35:26.433389 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a6273-6501-4945-b88b-4c20519e1164 admin admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:35:26.438954 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:35:26.502219 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec2d3c-d099-4f50-a4aa-17b610a3d1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:35:26.503163 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec2d3c-d099-4f50-a4aa-17b610a3d1e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:35:26.503475 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec2d3c-d099-4f50-a4aa-17b610a3d1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:35:26.503746 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec2d3c-d099-4f50-a4aa-17b610a3d1e5 admin admin] PATH_INFO: `/v3/users/b587fa488e8c4ba5834cd16f01f7de36` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:35:26.505354 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec2d3c-d099-4f50-a4aa-17b610a3d1e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b587fa488e8c4ba5834cd16f01f7de36)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:35:26.507388 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec2d3c-d099-4f50-a4aa-17b610a3d1e5 admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:35:26.574748 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-cdec2d3c-d099-4f50-a4aa-17b610a3d1e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b587fa488e8c4ba5834cd16f01f7de36'} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:35:26.590330 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-cdec2d3c-d099-4f50-a4aa-17b610a3d1e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b587fa488e8c4ba5834cd16f01f7de36'} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:35:26.591219 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-cdec2d3c-d099-4f50-a4aa-17b610a3d1e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b587fa488e8c4ba5834cd16f01f7de36'} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:35:26.600614 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-cdec2d3c-d099-4f50-a4aa-17b610a3d1e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b587fa488e8c4ba5834cd16f01f7de36'} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:35:26.601450 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-cdec2d3c-d099-4f50-a4aa-17b610a3d1e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b587fa488e8c4ba5834cd16f01f7de36'} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:35:26.617958 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 635/1259] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 24 17:35:26 2022] DELETE /identity/v3/users/b587fa488e8c4ba5834cd16f01f7de36 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:35:26.818292 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ec9c0-8077-4782-ad12-466b9ad6de2a admin admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:35:26.819954 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-207ec9c0-8077-4782-ad12-466b9ad6de2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:35:26.837421 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ec9c0-8077-4782-ad12-466b9ad6de2a admin admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:35:26.906878 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2047bd9-83dc-433b-8936-1b2b90d0851f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:35:26.907869 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2047bd9-83dc-433b-8936-1b2b90d0851f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:35:26.908198 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2047bd9-83dc-433b-8936-1b2b90d0851f admin admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:35:26.908477 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2047bd9-83dc-433b-8936-1b2b90d0851f admin admin] PATH_INFO: `/v3/projects/bc13e99c11b14a2583b1b044199039fe` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:35:26.909951 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2047bd9-83dc-433b-8936-1b2b90d0851f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc13e99c11b14a2583b1b044199039fe)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:35:26.912405 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2047bd9-83dc-433b-8936-1b2b90d0851f admin admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:35:26.922830 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:35:26.970101 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-e2047bd9-83dc-433b-8936-1b2b90d0851f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc13e99c11b14a2583b1b044199039fe', 'request_id': 'req-e2047bd9-83dc-433b-8936-1b2b90d0851f'} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:35:26.977175 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-e2047bd9-83dc-433b-8936-1b2b90d0851f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc13e99c11b14a2583b1b044199039fe', 'request_id': 'req-e2047bd9-83dc-433b-8936-1b2b90d0851f'} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:35:26.984895 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-e2047bd9-83dc-433b-8936-1b2b90d0851f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc13e99c11b14a2583b1b044199039fe', 'request_id': 'req-e2047bd9-83dc-433b-8936-1b2b90d0851f'} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:35:26.996172 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-e2047bd9-83dc-433b-8936-1b2b90d0851f admin admin] The token cache is being invalidate because project bc13e99c11b14a2583b1b044199039fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 17:35:26.996455 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-e2047bd9-83dc-433b-8936-1b2b90d0851f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:35:26.997082 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-e2047bd9-83dc-433b-8936-1b2b90d0851f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:35:26.998662 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 625/1260] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 24 17:35:26 2022] DELETE /identity/v3/projects/bc13e99c11b14a2583b1b044199039fe => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:35:36.613419 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:35:36.993229 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:36:40.393596 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec2d3c-d099-4f50-a4aa-17b610a3d1e5 admin admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:36:40.395587 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-cdec2d3c-d099-4f50-a4aa-17b610a3d1e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:36:40.467616 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec2d3c-d099-4f50-a4aa-17b610a3d1e5 admin admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:36:40.528231 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1d57a-33fc-4e1a-85bb-6836d297e2de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ff8200a750d49b1830c58f279e569c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:36:40.528892 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1d57a-33fc-4e1a-85bb-6836d297e2de service nova] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:36:40.529163 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1d57a-33fc-4e1a-85bb-6836d297e2de service nova] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:36:40.529435 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1d57a-33fc-4e1a-85bb-6836d297e2de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:36:40.531502 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-01f1d57a-33fc-4e1a-85bb-6836d297e2de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:36:40.612207 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1d57a-33fc-4e1a-85bb-6836d297e2de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:36:40.613868 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1d57a-33fc-4e1a-85bb-6836d297e2de service nova] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:36:40.632773 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 636/1261] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:36:40 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:36:47.117147 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2047bd9-83dc-433b-8936-1b2b90d0851f admin admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:36:47.119005 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-e2047bd9-83dc-433b-8936-1b2b90d0851f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:36:47.185211 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2047bd9-83dc-433b-8936-1b2b90d0851f admin admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:36:47.189467 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ed541-7144-4830-b68b-b5173b8d4f60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6385ebfadc74598b3b024408455842e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:36:47.190113 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ed541-7144-4830-b68b-b5173b8d4f60 service neutron] REQUEST_METHOD: `GET` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:36:47.190391 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ed541-7144-4830-b68b-b5173b8d4f60 service neutron] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:36:47.190666 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ed541-7144-4830-b68b-b5173b8d4f60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:36:47.193109 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-5a7ed541-7144-4830-b68b-b5173b8d4f60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:36:47.271710 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ed541-7144-4830-b68b-b5173b8d4f60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:36:47.273174 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ed541-7144-4830-b68b-b5173b8d4f60 service neutron] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:36:47.283502 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 626/1262] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:36:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:36:50.630066 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=93 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:36:53.904238 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1d57a-33fc-4e1a-85bb-6836d297e2de service nova] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:36:53.905827 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-01f1d57a-33fc-4e1a-85bb-6836d297e2de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:36:53.923909 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1d57a-33fc-4e1a-85bb-6836d297e2de service nova] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:36:53.932894 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca2075-1da9-4bee-9751-f8ab7ba40449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:36:53.934768 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca2075-1da9-4bee-9751-f8ab7ba40449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:36:53.935260 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca2075-1da9-4bee-9751-f8ab7ba40449 admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:36:53.935521 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca2075-1da9-4bee-9751-f8ab7ba40449 admin admin] PATH_INFO: `/v3/users/66beb08e5cb24d57aa4b41137cf3d649` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:36:53.936938 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca2075-1da9-4bee-9751-f8ab7ba40449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66beb08e5cb24d57aa4b41137cf3d649)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:36:53.939682 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca2075-1da9-4bee-9751-f8ab7ba40449 admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:36:53.997389 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-0eca2075-1da9-4bee-9751-f8ab7ba40449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66beb08e5cb24d57aa4b41137cf3d649'} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:36:54.013708 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-0eca2075-1da9-4bee-9751-f8ab7ba40449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66beb08e5cb24d57aa4b41137cf3d649'} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:36:54.014685 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-0eca2075-1da9-4bee-9751-f8ab7ba40449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66beb08e5cb24d57aa4b41137cf3d649'} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:36:54.025735 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-0eca2075-1da9-4bee-9751-f8ab7ba40449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66beb08e5cb24d57aa4b41137cf3d649'} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:36:54.026424 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-0eca2075-1da9-4bee-9751-f8ab7ba40449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66beb08e5cb24d57aa4b41137cf3d649'} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:36:54.043567 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 637/1263] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 24 17:36:53 2022] DELETE /identity/v3/users/66beb08e5cb24d57aa4b41137cf3d649 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:36:54.246434 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ed541-7144-4830-b68b-b5173b8d4f60 service neutron] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:36:54.269582 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ed541-7144-4830-b68b-b5173b8d4f60 service neutron] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:36:54.341985 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3aef09-b14f-4fa0-a6a7-6a879b5a2df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:36:54.342904 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3aef09-b14f-4fa0-a6a7-6a879b5a2df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:36:54.343184 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3aef09-b14f-4fa0-a6a7-6a879b5a2df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:36:54.343463 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3aef09-b14f-4fa0-a6a7-6a879b5a2df0 admin admin] PATH_INFO: `/v3/projects/207704ad3e894c26b00504c28704adb3` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:36:54.344726 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3aef09-b14f-4fa0-a6a7-6a879b5a2df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=207704ad3e894c26b00504c28704adb3)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:36:54.346770 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3aef09-b14f-4fa0-a6a7-6a879b5a2df0 admin admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:36:54.404808 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-0b3aef09-b14f-4fa0-a6a7-6a879b5a2df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '207704ad3e894c26b00504c28704adb3', 'request_id': 'req-0b3aef09-b14f-4fa0-a6a7-6a879b5a2df0'} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:36:54.406955 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:36:54.413638 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-0b3aef09-b14f-4fa0-a6a7-6a879b5a2df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '207704ad3e894c26b00504c28704adb3', 'request_id': 'req-0b3aef09-b14f-4fa0-a6a7-6a879b5a2df0'} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:36:54.425658 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-0b3aef09-b14f-4fa0-a6a7-6a879b5a2df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '207704ad3e894c26b00504c28704adb3', 'request_id': 'req-0b3aef09-b14f-4fa0-a6a7-6a879b5a2df0'} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:36:54.438507 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-0b3aef09-b14f-4fa0-a6a7-6a879b5a2df0 admin admin] The token cache is being invalidate because project 207704ad3e894c26b00504c28704adb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 17:36:54.438816 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-0b3aef09-b14f-4fa0-a6a7-6a879b5a2df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:36:54.439509 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-0b3aef09-b14f-4fa0-a6a7-6a879b5a2df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:36:54.441144 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 627/1264] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 24 17:36:54 2022] DELETE /identity/v3/projects/207704ad3e894c26b00504c28704adb3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:36:54.455734 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca2075-1da9-4bee-9751-f8ab7ba40449 admin admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:36:54.457400 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-0eca2075-1da9-4bee-9751-f8ab7ba40449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:36:54.474090 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca2075-1da9-4bee-9751-f8ab7ba40449 admin admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:36:54.555072 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b84e2-158e-4ede-b366-0c613ea6631c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:36:54.555868 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b84e2-158e-4ede-b366-0c613ea6631c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:36:54.556140 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b84e2-158e-4ede-b366-0c613ea6631c admin admin] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:36:54.556811 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b84e2-158e-4ede-b366-0c613ea6631c admin admin] PATH_INFO: `/v3/users/2021931766174a22bfecce1fd19966fb` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:36:54.574101 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b84e2-158e-4ede-b366-0c613ea6631c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2021931766174a22bfecce1fd19966fb)` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:36:54.576111 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b84e2-158e-4ede-b366-0c613ea6631c admin admin] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:36:54.651083 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-e95b84e2-158e-4ede-b366-0c613ea6631c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2021931766174a22bfecce1fd19966fb'} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:36:54.671069 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:36:54.672832 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-e95b84e2-158e-4ede-b366-0c613ea6631c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2021931766174a22bfecce1fd19966fb'} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:36:54.673939 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-e95b84e2-158e-4ede-b366-0c613ea6631c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2021931766174a22bfecce1fd19966fb'} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:36:54.684159 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-e95b84e2-158e-4ede-b366-0c613ea6631c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2021931766174a22bfecce1fd19966fb'} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:36:54.684854 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.notifications [None req-e95b84e2-158e-4ede-b366-0c613ea6631c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2021931766174a22bfecce1fd19966fb'} {{(pid=87096) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:36:54.703912 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 638/1265] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 24 17:36:54 2022] DELETE /identity/v3/users/2021931766174a22bfecce1fd19966fb => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:36:54.910786 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3aef09-b14f-4fa0-a6a7-6a879b5a2df0 admin admin] Authenticating user token {{(pid=87095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:36:54.912500 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.fernet_utils [None req-0b3aef09-b14f-4fa0-a6a7-6a879b5a2df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:36:54.928175 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3aef09-b14f-4fa0-a6a7-6a879b5a2df0 admin admin] Validating token access rules against request {{(pid=87095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:36:54.987250 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0e004-5d2a-4209-80f8-2438fa703b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9689251030946e8ba0417a0a5385957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2ee206730346a086b9b4fdd7759036', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:36:54.988168 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0e004-5d2a-4209-80f8-2438fa703b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:36:54.988478 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0e004-5d2a-4209-80f8-2438fa703b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:36:54.988745 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0e004-5d2a-4209-80f8-2438fa703b52 admin admin] PATH_INFO: `/v3/projects/3a40efe1f5c44570a28a71fb13e63171` {{(pid=87095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:36:54.999284 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0e004-5d2a-4209-80f8-2438fa703b52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a40efe1f5c44570a28a71fb13e63171)` {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:36:55.001249 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0e004-5d2a-4209-80f8-2438fa703b52 admin admin] RBAC: Authorization granted {{(pid=87095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:36:55.054252 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-09f0e004-5d2a-4209-80f8-2438fa703b52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a40efe1f5c44570a28a71fb13e63171', 'request_id': 'req-09f0e004-5d2a-4209-80f8-2438fa703b52'} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:36:55.059942 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-09f0e004-5d2a-4209-80f8-2438fa703b52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a40efe1f5c44570a28a71fb13e63171', 'request_id': 'req-09f0e004-5d2a-4209-80f8-2438fa703b52'} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:36:55.069893 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-09f0e004-5d2a-4209-80f8-2438fa703b52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a40efe1f5c44570a28a71fb13e63171', 'request_id': 'req-09f0e004-5d2a-4209-80f8-2438fa703b52'} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:36:55.081740 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-09f0e004-5d2a-4209-80f8-2438fa703b52 admin admin] The token cache is being invalidate because project 3a40efe1f5c44570a28a71fb13e63171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 17:36:55.081929 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-09f0e004-5d2a-4209-80f8-2438fa703b52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:36:55.082664 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG keystone.notifications [None req-09f0e004-5d2a-4209-80f8-2438fa703b52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 17:36:55.084279 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: [pid: 87095|app: 0|req: 628/1266] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 24 17:36:54 2022] DELETE /identity/v3/projects/3a40efe1f5c44570a28a71fb13e63171 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 17:37:04.699951 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=7,keystone:INSERT=1,keystone:DELETE=1 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:37:05.078454 dv-osbrick-847593-1-ceph devstack@keystone.service[87095]: DEBUG dbcounter [-] [87095] Writing DB stats keystone:SELECT=61,keystone:DELETE=9,keystone:INSERT=2 {{(pid=87095) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 17:39:37.106889 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b84e2-158e-4ede-b366-0c613ea6631c admin admin] Authenticating user token {{(pid=87096) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 17:39:37.108533 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-e95b84e2-158e-4ede-b366-0c613ea6631c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:39:37.202969 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b84e2-158e-4ede-b366-0c613ea6631c admin admin] Validating token access rules against request {{(pid=87096) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 17:39:37.263063 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4304ca-eef3-42fc-86b4-09f7e64c448e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b318b7cfb1c5485cba96997ddd73945c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb66039441c14b96a79a30de4a833fa2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87096) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 17:39:37.263710 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4304ca-eef3-42fc-86b4-09f7e64c448e service placement] REQUEST_METHOD: `GET` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 17:39:37.263986 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4304ca-eef3-42fc-86b4-09f7e64c448e service placement] SCRIPT_NAME: `/identity` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 17:39:37.264255 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4304ca-eef3-42fc-86b4-09f7e64c448e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87096) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 17:39:37.266185 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.fernet_utils [None req-1c4304ca-eef3-42fc-86b4-09f7e64c448e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87096) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 17:39:37.277615 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4304ca-eef3-42fc-86b4-09f7e64c448e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 17:39:37.279244 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4304ca-eef3-42fc-86b4-09f7e64c448e service placement] RBAC: Authorization granted {{(pid=87096) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 17:39:37.289104 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: [pid: 87096|app: 0|req: 639/1267] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 24 17:39:37 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 17:39:47.285187 dv-osbrick-847593-1-ceph devstack@keystone.service[87096]: DEBUG dbcounter [-] [87096] Writing DB stats keystone:SELECT=67 {{(pid=87096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}